Automated control of an electrochromic device

ABSTRACT

Automated control of an electrochromic device is described. A method includes receiving a first image captured from a first viewpoint of an electrochromic device. The method further includes identifying at least one of an obstructed portion of the first image or an unobstructed portion of the first image. The method further includes generating an obstruction map based on the at least one of the obstructed portion of the first image or the unobstructed portion of the first image. The method further includes determining, based on the obstruction map, a desired tinting state of the electrochromic device and causing a current tinting state of the electrochromic device to correspond to the desired tinting state.

RELATED APPLICATIONS

This application claims the benefit of U.S. Provisional No. 62/890,040,filed Aug. 21, 2019, and U.S. Provisional No. 62/819,981, filed Mar. 18,2019, the entire contents of which are incorporated by reference.

BACKGROUND

An electrochromic glass unit uses electrochromic glass that can changetransmittance with the application of electric current and voltage. Thechange of transmittance typically relies on a reversible oxidation of amaterial. Electrochromic glass units can darken at the press of a buttonor other triggering events and are also often used in building windowsto reduce glare and solar heat gains.

BRIEF DESCRIPTION OF DRAWINGS

The present disclosure will be understood more fully from the detaileddescription given below and from the accompanying drawings of variousembodiments, which, however, should not be taken to limit the presentdisclosure to the specific embodiments, but are for explanation andunderstanding only.

FIG. 1 is a block diagram of an electrochromic window system, accordingto certain embodiments.

FIG. 2 is a block diagram of an electrochromic window system includingan automated control module, according to certain embodiments.

FIGS. 3A-D are flow diagrams of methods for providing control of anelectrochromic device using an obstruction map, according to certainembodiments.

FIG. 4A illustrates an electrochromic device that is to be controlled byusing an obstruction map, according to certain embodiments.

FIG. 4B-C illustrates a camera that is used to capture one or moreimages for generating the obstruction map, according to certainembodiments.

FIG. 4D is a graph illustrating a polynomial fit to observed angulardistortion of a camera, according to certain embodiments.

FIGS. 4E-G illustrate fisheye images from a viewpoint of theelectrochromic device, according to certain embodiments.

FIGS. 4H-I illustrate images captured from the left and the right sideof the electrochromic device, according to certain embodiments.

FIG. 4J illustrates rendering from inside a cube in equi-rectangularprojection, according to certain embodiments.

FIG. 4K illustrates rendering from inside a cube in orthonormalpseudo-cylindrical projection, according to certain embodiments.

FIG. 4L illustrates a remapped hemispherical fisheye photo toequi-rectangular projection, according to certain embodiments.

FIG. 4M illustrates a remapped hemispherical fisheye photo toorthonormal pseudo-cylindrical projection, according to certainembodiments.

FIG. 4N illustrates an image from a left side of a window remapped to anorthonormal pseudo-cylindrical projection, according to certainembodiments.

FIG. 4O illustrates an image from a right side of a window remapped toan orthonormal pseudo-cylindrical projection, according to certainembodiments.

FIG. 4P illustrates the image from the left side (e.g., FIG. 4N) and theimage from the right side (e.g., FIG. 4O) combined into a singlecomposite image, according to certain embodiments.

FIG. 4Q illustrates a polygon traced over the orthonormalpseudo-cylindrical image and a resulting black/white Boolean image,according to certain embodiments.

FIG. 4R illustrates a plot of queried solar positions overlaid on atraced image, according to certain embodiments.

FIG. 4S illustrates geometrically derived obstruction maps, according tocertain embodiments.

FIG. 4T is an obstruction map generated using geometric method,according to certain embodiments.

FIG. 4U is an obstruction map generated using a ray-tracing method,according to certain embodiments.

FIG. 4V is a comparison of obstruction maps generated with differentmethods, according to certain embodiments.

FIG. 4W illustrates a rendering of the façade with the sun located inthe region of discrepancy between obstruction maps, according to certainembodiments.

FIG. 4X illustrates a sun path overlaid on an overhang obstruction mapusing an equi-rectangular projection, according to certain embodiments.

FIG. 4Y illustrates a sun path overlaid on an overhang obstruction mapusing an orthonormal pseudo-cylindrical projection, according to certainembodiments.

FIG. 4Z illustrates an image for generating an interior facing allowablesunlight map and the allowable sunlight map, according to certainembodiments.

FIG. 5 illustrates a diagrammatic representation of a machine in theexample form of a computer system including a set of instructionsexecutable by a computer system for automated control of anelectrochromic device according to any one or more of the methodologiesdiscussed herein.

FIG. 6 illustrates a reflection map for automated control of anelectrochromic device, according to certain embodiments.

FIG. 7 illustrates a 3D model of a site for generating a reflection map,according to certain embodiments.

FIG. 8 illustrates a rendering of the site from a view of anelectrochromic device, according to certain embodiments.

FIG. 9A illustrates a reflectance map generated for a 3D model,according to certain embodiments.

FIG. 9B illustrates a reflection map that has been resampled, accordingto certain embodiments.

FIG. 10A illustrates a plan view of a 3D model associated with areflection map with example reflection rays, according to certainembodiments.

FIG. 10B illustrates a reflection map with boxes around sun positions,according to certain embodiments.

FIG. 10C illustrates a reflection map with coordinates of spot checks,according to certain embodiments.

FIGS. 11A-G illustrate rendered models for sets of coordinates,according to certain embodiments.

FIGS. 12A-D illustrate reflection maps, according to certainembodiments.

FIG. 13 illustrates a graph of equations that relate surface reflectanceto pixel value, according to certain embodiments.

FIG. 14 illustrates use of a daylight coefficient, according to certainembodiments.

FIG. 15 illustrates a three-phase method to break flux transfer intothree phases, according to certain embodiments.

FIGS. 16A-C are flow diagrams of methods for providing automated controlof an electrochromic device, according to certain embodiments.

FIGS. 17A-B illustrate examples of one or more images captured of thesun using a camera, according to certain embodiments.

FIGS. 18A-B illustrate examples of images captured of an electrochromicdevice, according to certain embodiments.

FIGS. 19A-F illustrate a series of images of an electrochromic devicecaptured over time, according to certain embodiments.

DETAILED DESCRIPTION

Automated control of an electrochromic device (e.g., using one or moreof an obstruction map, allowable sunlight map, reflection map,illuminance value, or the like) is described. Electrochromic devices canbe, for example, used for smart windows in a commercial or residentialbuilding. A smart window refers to one or more glass units whosecharacteristics (e.g., a tint level representing a particulartransmittance parameter, optical scattering characteristics, etc.) canbe changed automatically (e.g., at a particular time, in response to aweather condition, etc.). Selectively tinting smart windows may allowsome control of solar heat gain of a building to decrease energy usedfor heating and/or cooling (e.g., tinting smart windows on sunny summerdays allows for less solar heat gain, untinting smart windows in sunnywinter days allows for more solar heat gain). Selectively tinting smartwindows may provide effective use of daylight (e.g., daylighting) todecrease energy used for lighting. Whereas properly controlled smartwindows may reduce energy used for heating, cooling, and lighting,improper control of smart windows may increase energy consumption anddecrease user comfort (e.g., not properly allowing natural light,allowing glare from direct sunlight, etc.). A modern multi-storybuilding can include thousands of external and internal windows. Assuch, controlling electrochromic devices in an efficient manner becomesincreasingly important.

Conventional systems typically use local computers to controlelectrochromic devices by using external light data from an exteriorsensor. For example, the local computer may untint the electrochromicdevices to allow natural light into a room responsive to receivingexternal light data from a roof-mounted sensor indicating that theroof-mounted sensor is not receiving direct sunlight. The local computermay tint electrochromic devices to avoid glare (e.g., avoid directsunlight shining on the occupants of the room) responsive to receivingexternal light data from a roof-mounted sensor indicating that theroof-mounted sensor is receiving direct sunlight.

The use of local computers with a roof-mounted sensor to controlelectrochromic devices based on external light data has severaldeficiencies. For example, the local computer may tint all of theconnected electrochromic devices responsive to detecting direct sunlightby the roof-mounted sensor. However, for some of the electrochromicdevices, the direct sunlight may be blocked by one or more obstructions,such as a building overhang, one or more neighboring buildings, a tree,etc. Tinting an electrochromic device that is obstructed from directsunlight may cause occupant dissatisfaction since occupants may preferto have natural light via untinted electrochromic devices if there is noglare. Tinting an electrochromic device that is obstructed from directsunlight causes increased energy usage, processor overhead, and requiredbandwidth to unnecessarily tint and untint the electrochromic device(e.g., during partly cloudy weather conditions). Tinting anelectrochromic device that is obstructed from direct sunlight may causeenergy inefficiencies of a building (e.g., an unnecessarily tintedelectrochromic device may increase energy used for lighting and/orheating, whereas an untinted electrochromic device could help lower theenergy used for electric lighting and/or heating).

Aspects of the present disclosure address the deficiencies ofconventional systems by providing automated control of an electrochromicdevice. The present disclosure may provide automated control of anelectrochromic device to account for one or more types of glare, such asdirect sunlight (e.g., via an obstruction map, allowable sunlight map),specular reflection (e.g., via a reflection map), illuminance such asdiffuse reflection (e.g., via an illuminance value), or the like.

In some embodiments, a server device may generate an obstruction mapthat indicates an obstructed portion and/or an unobstructed portion ofan electrochromic device. For example, from the viewpoint of anelectrochromic device looking outside, a building overhang, one or morebuildings, a tree, etc. that block the electrochromic device (e.g., comebetween the sun and the electrochromic device) may correspond to anobstructed portion of the sky that shades the electrochromic device. Theserver device may determine, based on the obstruction map, a desiredtinting state of the electrochromic device (e.g., whether theelectrochromic device should be tinted or untinted). Responsive todetermining the desired tinting state of the electrochromic device, theserver device may cause the current tinting state of the electrochromicdevice to correspond to the determined desired tinting state (e.g., bytransmitting instructions to the gateway that controls the drivercoupled to the electrochromic device). For example, the server devicemay send instructions to change the tinting state of the electrochromicdevice to match the desired tinting state (e.g., if the server device isaware of the current tinting state of the electrochromic device).Alternatively, the server device may send instructions including thedesired tinting state and the gateway or the driver may decide whetherthe tinting state of the electrochromic device should be changed tomatch the desired tinting state. As used herein, the server device mayrefer to a single server device or multiple server devices. In someembodiments, one or more other components (e.g., gateway, etc.) mayperform some of the functionalities described herein as performed by aserver device. As used herein, the tinting state may refer to aparticular tint level. For example, the tinting state may be tinted oruntinted (e.g., tinted may be above 50% tinted and untinted may be below50% tinted, tinted may be at least 75% tinted and untinted may be atmost 25% tinted, etc.), or have more variations that each represent adistinct tint level (e.g., tint level 1, tint level 2, tint level n,etc.).

In some embodiments, the server device may generate the obstruction mapbased on one or more images (e.g., a photographic method). The serverdevice may receive an image captured from a viewpoint of theelectrochromic device, where the viewpoint faces exterior of a roomassociated with the electrochromic device (e.g., an image taken from theelectrochromic device directed to outside). The server device mayidentify an obstructed portion and/or an unobstructed portion of theimage (e.g., blue pixels corresponding to sky may be unobstructedportion of the image, responsive to receiving user input identifying anobstructed portion and/or unobstructed portion). The server device maygenerate the obstruction map based on the obstructed portion of theimage and/or the unobstructed portion of the image.

In some embodiments, the server device may generate the obstruction mapbased on one or more dimensions (e.g., geometries of the electrochromicdevice and/or obstructions, based on an analytics method). The serverdevice may receive first dimensions of the electrochromic device (e.g.,height, width, or thickness of the electrochromic device) and seconddimensions (e.g., an overhang, height of the overhang above theelectrochromic device, extension of the overhang) of one or moreobstructions of the electrochromic device. The server device maygenerate the obstruction map based on the first and second dimensions.

In some embodiments, the server device may generate the obstruction mapbased on a three-dimensional (3D) model of environment relative to theelectrochromic device (e.g., a ray-tracing method). The 3D model mayinclude the electrochromic device, the building corresponding to theelectrochromic device, overhangs of the building, additional buildingsproximate to the electrochromic device, etc.

In some embodiments, the server device may generate the obstruction mapbased on two or more of an image, dimensions, or a 3D model.

In some embodiments, the server device may receive propagationinformation indicating one or more portions of a room (corresponding tothe electrochromic device) where direct sunlight is allowed. Thepropagation information may include a distance from the electrochromicdevice (e.g., three feet into the room from the electrochromic device)and/or a height (e.g., three feet into the room and two feet off of thefloor) where direct sunlight is allowed. The propagation information mayinclude an image from a viewpoint of the electrochromic device lookinginto the room, where a propagation portion of the image corresponds toportions of the room where direct sunlight can propagate (e.g., thefloor). The server device may use the propagation information (e.g., inaddition to the obstruction map) to determine the desired tinting stateof the electrochromic device.

In some embodiments, the server device may receive a sun map (e.g., sunpath) or sun position table indicating the position of the sun relativeto the electrochromic device (e.g., trajectory of the sun at differenttimes of the day and different days of the year). The server device mayreceive sensor data (e.g., indicating direct sunlight or no directsunlight) from one or more exterior sensors. The server device maydetermine the desired tinting state of the electrochromic device basedon comparing the obstruction map to the sun map to determine whether thesun is within the unobstructed portion of the obstruction map and basedon determining whether there is current direct sunlight in view of thesensor data.

Aspects of the present disclosure result in technological advantages ofsignificant reduction in energy consumption (e.g., battery consumption,heating energy, cooling energy, lighting energy, etc.), requiredbandwidth, processor overhead, and so forth. In some embodiments, thetechnological advantages result from using one or more of an obstructionmap, a reflection map, or an illuminance value to control anelectrochromic device. By using one or more of an obstruction map, areflection map, or an illuminance value, a server device may causetinting of only electrochromic devices that would have glare and nottint electrochromic devices where there is allowable daylight (e.g.,obstructed direct sunlight, no reflected sunlight, allowable amount ofilluminance, obstructed glare, or the like). This provides more occupantsatisfaction since occupants may prefer to have natural light via theelectrochromic devices if there is no glare and may reduce the switchingof tint level of the electrochromic devices that do not have glare(e.g., are obstructed from glare). By using one or more of anobstruction map, a reflection map, or an illuminance value to provideautomated control of electrochromic devices lowers energy usage,processor overhead, and required bandwidth, as the tint levels of theelectrochromic devices are not unnecessarily changed. By using one ormore of an obstruction map, a reflection map, or an illuminance value,unnecessary tinting of electrochromic devices (e.g., obstructed fromdirect sunlight, that do not have reflections, that have an allowableilluminance value) can be avoided, which may increase energyefficiencies of buildings as untinted windows may lower the buildingheating and lighting requirements.

FIG. 1 is a block diagram of an electrochromic window system 100 (e.g.,smart window system) that provides automated control of anelectrochromic device (e.g., using one or more of an obstruction map,allowable sunlight map, reflection map, illuminance value, or the like),according to one embodiment. The electrochromic window system 100includes a first cabinet 108 in which a first distributed energymanagement system (EMS) 102, a first set of drivers 104, and a gateway106 are located. In an alternate embodiment, the drivers 104 may beintegrated drivers where one or more drivers are integrated into the ECwindows. Each of the set of drivers 104 is coupled to an individual oneof a set of electrochromic (EC) windows 130. Alternatively, otherelectrochromic devices can be driven by the set of drivers 104. The setof drivers 104 are coupled to the set of EC windows 130 via power cables148 and control wires. The cabinet 108 can be a standard size, such as28″, 42″, or 60″. The cabinet 108 can be located in proximity to the ECwindows 130 or located away from the EC windows 130, such as up to 300feet. The cabinet 108 can be located in a location that reduces wiringcosts. Between each driver and EC window there may be one or more powercables 148 coupled to an anode of the EC window and one or more powercables 148 coupled to a cathode of the EC window. There may be twocontrol wires for sensing the voltage of the EC window (referred toherein as sense voltage or Vsense) and two wires for sequestrationoperations, as described herein. In one embodiment, each driver of theset of drivers 104 can supply up to 8 amps to each EC window of the setof EC windows 130. An external power supply 132 is coupled to provideexternal power to the distributed EMS 102, the set of drivers 104, andthe gateway 106 within the first cabinet 108. For example, 16 AWG 2conductor plenum cables can provide lower voltage (48V) or highervoltage (110-240V) to the first cabinet 108. The external power supply132 can be located in proximity to the first cabinet 108 or farther awayfrom the first cabinet 108, such as up to up to hundreds of feet or upto 1000 feet. In some embodiments, the external power supply 132 isconfigured to supply less than 25% of a maximum power used by the set ofEC windows 130 during switching of one or more of the set of EC windows130. Additional external power supplies can be used to power thecomponents in the first cabinet 108. The external power supply 132 maybe a conventional power supply connected to the power grid or it may bea building battery such as the residential batteries built by Tesla (thePowerwall battery) or LG Chem's RESU battery that obtain energy from asource such as on-site solar energy cells. The external power supply 132may be a combination of the power grid and a building battery.

Although portions of the present disclosure describe the electrochromicwindow system 100 in relation to a distributed EMS, the electrochromicwindow system 100 may include one or more different types of powersources (e.g., a battery, a local power source inside of a driver, amulti-device boost power supply, etc.) in addition to or instead of thedistributed EMS.

In some embodiments, a driver for an EC window may be integrated intothe EC window itself in either the frame of the window, in theintegrated glass unit (IGU) of the EC window, or in the laminated glassunit (LGU) of the EC window.

Each EC window may include an electrochromic panel (e.g., glass or film)that can change transmittance with the application of electric currentand voltage. The change of transmittance typically relies on areversible oxidation of a material. Electrochromic units can darken atthe press of a button (e.g., user input via tint selector 120 or 128,dashboard web app 140, dashboard mobile app 142, etc.) or in response toan automatic triggering event and are also often used in automobilerearview mirrors to reduce reflective glare. In some embodiments, uponreceiving user input via the tint selector 120 to tint a first EC windowassociated with a first driver, the tint selector 120 may transmitinstructions to the first driver and the first driver may control thetint level of the EC window. In some embodiments, upon receiving userinput via a user device to tint a first EC window associated with afirst driver, dashboard web app 140 or dashboard mobile app 142 (e.g.,executing on the user device) may transmit the user input to the cloudcomputing system 110, the cloud computing system 110 may transmit theuser input to the gateway 106, and the gateway 106 may transmit the userinput to the first driver to cause the first driver to control the tintlevel of the first EC window. The different transmissivities of the ECwindows may be referred to as tint levels (e.g., 0% tint level is 65%transmittance, 50% tint level is 21% transmittance, 100% tint level is2% transmittance, etc.).

In some embodiments, one or more power sources (e.g., the distributedEMS, a battery, a local power source inside of a driver, a multi-deviceboost power supply, etc.) may provide additional power (e.g., boostpower) to an electrochromic device (e.g., EC window 130) that can besupplied by a main power supply. The one or more power sources maysupport a varied number of EC windows based on geometry and size of theEC windows, how often the EC windows are tinted, as well as how lowother power sources (e.g., the batteries of the distributed EMS 102) canbe discharged.

Each power source (e.g., distributed EMS 102) may supply power to theset of drivers 104 according to a power state of the set of EC window130, as well as the power state of other power sources (e.g.,multi-device boost power supply 208). For example, the distributed EMS102 can supply a first amount of power to the set of drivers 104 from anexternal power supply interface in an idle state of the set of ECwindows 130. Alternatively, the distributed EMS 102 does not supplypower to the set of EC windows 130 in the idle state. In someembodiments the idle power level of an EC window may be zero, forexample when the type of EC device used only requires power to switchfrom one optical transmission state to another optical transmissionstate. The power state information (e.g., idle state, tinted state,transitioning between states, etc.) may be provided to the gateway 106and may be shared with the cloud computing system 110.

The additional power provided by the one or more power sources canenable fast and uniform switching in a variety of conditions, and inparticular when the EC window 130 includes a gradient conductive layer.

An EC window 130 including a gradient transparent conductive layer canhave very fast switching speed (e.g., less than 5 minutes, or less than10 minutes) as well as uniform transitions between states (e.g., wherethe clear state, dark state and all tinted states have delta E acrossthe area of the panel less than 10) by including one or more gradienttransparent conductive layers in each EC device or panel. The term“gradient transparent conductive layer” refers to an electricallyconducting layer with spatially varying sheet resistance, or resistanceto current flow substantially parallel to a major surface of the layer,that varies as a function of position within the electrically conductivelayer. The gradient transparent conductive layer or layers also enablethe driving of an EC window 130 incorporating such a layer at muchhigher voltages so that high amounts of power are required initially todrive fast switching. The gradient transparent conductive layer may be apatterned or graded transparent conductive oxide (TCO) such as indiumtitanium oxide and tantalum tin oxide. In other embodiments, thedistributed EMS 102 can be used in connection with drivers that driveother types of EC windows 130. Additionally, the distributed EMS can beused to drive multi-panel electrochromic windows that include more thanone EC window 130 connected in series or parallel. A multi-panelelectrochromic window may be one where the EC windows 130 are stackedover one another to provide very low transmittance of light through thedevices, for example less than 1% transmittance of light or less than0.1% transmittance of light. Alternatively the multi-panelelectrochromic windows may be “tiled” adjacent to one another such thatmore than one EC window 130 is laminated to a carrier glass substrate toform larger sized windows. In another embodiment a single driver may beused to drive multiple electrochromic windows that may be in a group ofelectrochromic windows. For example a single driver may drive two ormore electrochromic windows.

The gateway 106 is operatively coupled to a cloud computing system 110.A cloud computing system refers to a collection of physical machines(e.g., server devices), that host applications providing one or moreservices to multiple components (e.g., gateway 106, sensor hub 126,drivers 104, distributed EMS 102, user devices executing dashboardmobile app 142 or dashboard web app 140, etc.) via a network. In someimplementations, the applications hosted by cloud computing system 110may provide services (e.g., scheduling, viewing, remote management,automated control, glare control, etc.) to users accessing the cloudcomputing system 110 via a network. The applications may allow users tomanipulate (e.g., access, create, edit, store, delete, share,collaborate, print, etc.) electronic documents (e.g., schedules, rules,configurations, automated control, glare control, etc.). The cloudcomputing system 110 may include one or more server devices and one ormore data stores. The cloud computing system 110 may include anautomated control module 224 (see FIG. 2 ). The automated control module224 may include one or more applications, one or more server devices,etc. The gateway 106 can be hardwired (e.g., via Ethernet) to a networkdevice of a local area network, to gain access to a private or publicnetwork to access the cloud computing system 110. The gateway 106 cancommunicate with the cloud computing system 110 over Cat 5 wiring usingthe TCP/IP protocol with TLS (SSL) for secure communications. Thegateway 106 can communicate with the cloud computing system 110 usingsecure communications, such as using IPV4, IPv6, or Transport LayerSecurity (TLS) networking protocols. The cloud computing system 110 canprovide control logic, automated control (e.g., glare control, causetint level of the EC windows 130 to be set to avoid glare), andconfiguration for the electrochromic window system 100. The cloudcomputing system 110 may receive information (e.g., via one or moreapplication programming interfaces (APIs), weather information, etc.)for providing automated control, etc. The cloud computing system 110 maydetermine which EC windows 130 each device (e.g., tint selector 120 or128, gateway 106, etc.) and each application (e.g., dashboard mobile app142, dashboard web app 140, etc.) is authorized to view and/or controland the priority of control. For example, the cloud computing system 110may determine that the tint selector 120 is authorized to control ECwindows 130 that are connected to drivers 104. In another example, thecloud computing system 110 may determine that the dashboard mobile app142 logged in by a first user is authorized to view and control only thefirst window of the EC windows 130. During configuration (e.g.,commissioning, set-up by an administrator), the cloud computing system110 may receive instructions of which users and which devices areauthorized to control which EC windows 130. In some embodiments, thecloud computing system 110 may authorize access by components (e.g.,tint selectors 120 and 128, gateway 106, etc.) to a wireless meshnetwork (e.g., during commissioning or set-up) and once authorized,subsequent access of the wireless mesh network is not dependent onfurther authorization (e.g., components are authorized duringcommissioning or set-up and do not need further authorization tocontinue accessing).

In some embodiments, the cloud computing system 110 may use machinelearning to provide control of the EC windows 130. In some embodiments,the cloud computing system 110 may include a broker module to receivedata from the gateway 106, sensor hub 126, etc. (e.g., for providingautomated control, for providing data visibility) and to transmit datato other gateways 106. In some embodiments, control of the EC windows130 may be distributed over the cloud computing system 110 and thegateway 106. For example, the cloud computing system 110 may providesettings files (e.g., a schedule, rules, etc.) to the gateway 106 andthe gateway 106 may control the EC windows 130 based on the settingsfiles. The cloud computing system 110 may send additional instructionsto the gateway 106 to deviate from the settings files in controlling theEC windows 130 (e.g., responsive to the cloud computing system 110receiving user input via a dashboard mobile app 142, sensor data via thesensor hub 126, the gateway 106 may provide a conduit for control of theEC windows 130, etc.)

The cloud computing system 110 can provide automation algorithms, dataanalytics, user management, security protocols, and the like. The cloudcomputing system 110 can provide extensive system health monitoring andproactive troubleshooting, as well as provide third-party integrationwithout complicated on-site technical support. The cloud computingsystem 110 can provide a system dashboard to a dashboard web app 140 ona desktop computer, a dashboard mobile app 142 on a personal computingdevice, or both. The dashboard web app 140 and the dashboard mobile app142 can be used to monitor or control the electrochromic window system100. The dashboard web app 140 and the dashboard mobile app 142 areapplications that may be executed on one or more user devices. Forexample, the dashboard mobile app 142 may execute on a mobile userdevice, such as a smart phone or a tablet. The dashboard web app 140 mayexecute on a desktop, laptop, etc. The dashboard web app 140 or thedashboard mobile app 142 (executing on a user device) may receive userinput (e.g., selection of one or more EC windows and a tint level) viathe user device and may transmit the user input to the cloud computingsystem 110. Responsive to determining that the user input is a requestto view information (e.g., monitor current status of components, currentmode of EC windows 130, etc.), the cloud computing system 110 mayretrieve the information and transmit the information to the user deviceto cause the dashboard web app 140 or dashboard mobile app 142 todisplay the requested information. Responsive to determining that theuser input is a request to change operation of one or more components ofthe electrochromic window system 100, such as a request to tint a firstEC window associated with a first driver, the cloud computing system 110may transmit the user input to the gateway 106, the gateway 106 maytransmit the user input to the first driver, and the first driver maycontrol the tint level of the first EC window based on the user input.

The cloud computing system 110 can also interact with other devices ornetworks, such as with a second cloud computing system 146, asillustrated in FIG. 1 , that communicates with a voice-controlled device144. For example, the voice-controlled device 144 may receive audiblecommands from a user to control or get a report of the electrochromicwindow system 100. The dashboard web app 140 and the dashboard mobileapp 142 can communicate with the cloud computing system 110 using theTCP/IP protocol with TLS (SSL) and using encryption and authenticationfor secure communications. The cloud computing system 110 can include amicroservice architecture (e.g., application architecture) that isexposed through APIs to manage interaction with onsite components, suchas the gateways, drivers, and tint selectors. The cloud computing system110 can eliminate complicated onsite networking requirements, as theexternal control occurs through the APIs. The cloud computing system 110can provide centralized data aggregation from all deployments tofacilitate automation and analytics. The centralized data aggregation ofthe cloud computing system 110 may also include data from themanufacturing, testing, and assembly of the EC Windows 130 and anyassociated hardware of the electrochromic window system 100 (e.g.drivers 104, gateways 106, etc.). The cloud computing system 110 canleverage various authentication and authorization technologies to securesite access. The cloud computing system provides a robust platform thatfacilitates on-demand load scaling and health monitoring. The cloudcomputing system 110 can also provide a better path for onsite workloadmigration, backed by a robust central cloud store.

As described above, the gateway 106 communicates directly with the cloudcomputing system 110 through secured channel(s). The gateway 106communicates with the cloud computing system 110 on behalf of the set ofdrivers 104 and the distributed EMS 102. The gateway 106, the set ofdrivers 104, and the distributed EMS 102 communicate with each otherover wireless connections, such as over a secure thread wirelessnetwork. For example, each of these components can communicate usingIEEE 802.15.4, 2.4 GHz, IPv6 mesh network routing (thread). Thesecommunications can be encrypted with 128-bit AES encryption.Alternatively, other mesh networks can be used, as well as otherfrequencies, and encryption techniques.

It should be noted that, after the drivers and the distributed EMS areconfigured via the gateway, the distributed EMS and driver behavior isnot dependent on the gateway for safe operation. That is, the gatewaycan be disconnected and the drivers will not drain the batteries of thedistributed EMS.

As illustrated in FIG. 1 , the electrochromic window system 100 mayinclude additional devices, such as a tint selector 120, an occupancysensor 122, an occupancy sensor interface and thread range extender 138,a building sensor 124 (e.g., roof mounted irradiance sensor), and asensor hub 126.

The sensor hub 126 can be powered by an external power supply 136 andcan be hardwired to the local area network, much like the gateway 106.

The occupancy sensor interface, thread range extender 138, and occupancysensor 122 can be powered by an external power supply and can send orreceive signals to or from a lighting system or a building managementsystem (BMS). The tint selector 120 and occupancy sensor interface andthread range extender 138 can communicate with other devices on thewireless mesh network.

The tint selector 120 can be a device that is mounted on a wall where auser can activate a transition of one or more EC windows 130. The tintselector 120 can be mounted or otherwise disposed in a building havingthe EC windows 130 to permit user control of one or more EC windows 130(e.g., the set of EC windows). The tint selector 120 can be programmedto be part of group of EC windows (e.g., a set of windows that are to beset at the same tint level, e.g., all EC windows in the group tinted50%). That is the tint selector 120 can be associated with the set ofdrivers 104 and the gateway 106. Alternatively, the tint selector 120can be associated with a scene of one or more EC windows. Upon receivinguser input (e.g., via the tint selector 120) for EC windows to be tintedin a scene, one or more first EC windows of the scene are to be tintedat a first tint level and one or more second EC windows of the scene areto be tinted at a second tint level (e.g., all EC windows of the sceneare to be tinted 100% except for one EC window of the scene that is tobe tinted 50%). Upon receiving user input, the tint selector maytransmit (e.g., multicast) a signal to the corresponding drivers tocause the EC windows to change tint level. The tint selector may alsotransmit the user input to the gateway 106 to cause the gateway totransmit the user input to the cloud computing system 110.

The electrochromic window system 100 can include one or more additionaltint selectors, such as illustrated in FIG. 1 by a second tint selector128 that is also wirelessly coupled to the wireless mesh network. Thesecond tint selector 128 can be associated with the same group or sceneas the tint selector 120. Alternatively, the second tint selector 128can be associated with a different group or a different scene as thetint selector 120.

In a further embodiment, the electrochromic window system 100 caninclude one or more cabinets, such as illustrated in FIG. 1 with asecond cabinet 118. The second cabinet 118 can include a seconddistributed EMS 112 and a second set of drivers 114. In some cases, thesecond cabinet 118 does not include a second gateway and the gateway 106manages the second set of drivers 114 as well. An external power supply134 is coupled to provide external power to the second distributed EMS112 and the second set of drivers 114 within the second cabinet 118. Forexample, 16 AWG 2 conductor plenum cables can provide lower voltage(48V) or higher voltage (110-240V) to the second cabinet 118. Theexternal power supply 134 can be located in proximity to the secondcabinet 118 or farther away from the second cabinet 118, such as up to350 feet. In other cases, more than two cabinets may be used. It shouldalso be noted that additional external power supplies can be used topower the components in the cabinet 108 and the second cabinet 118.

Each component of the electrochromic window system 100 can be designedto automatically obtain critical operating data from the cloud computingsystem 110 to avoid a single failure requiring significant maintenancedowntime. Although various components are illustrated in FIG. 1 , inother embodiments, the electrochromic window system 100 may include moreor less components than as illustrated in FIG. 1 .

In another embodiment, the electrochromic window system 100 includesdrivers 160 located at each of the set of EC windows 130, instead of orin addition to the set of drivers 104 in the first cabinet 108. In somecases, each EC window 130 has a driver 160, as illustrated. In othercases, a single driver 160 can drive multiple EC windows 130. Thedrivers 160 can be coupled to an external power supply. The externalpower supply can be located at the EC window 130 or in close proximity.In this case, the external power supplies for the set of EC windows 130can be considered to be distributed, instead of centralized as describedabove. In other cases, the drivers 160 do not use an external powersupply.

It should be noted that various embodiments described herein aredescribed with respect to a commercial installation. In otherembodiments, the electrochromic window system 100 can be deployed in aresidential installation. In those cases, there may be modifications tothe electrochromic window system 100 as described above to accommodatedifferences between the commercial installation and the residentialinstallation.

In some embodiments (e.g., residential installations), one or more ofthe components of the electrochromic window system 100 may be combined.For example, one piece of hardware may include a gateway and two or moreelectrochromic windows (e.g., hardware that includes a gateway and oneor more drivers). In some embodiments (e.g., residential installations),the gateway may transmit data less frequently and/or transmit less data.In some examples, the gateway transmits data at a predetermined point intime (e.g., without transmitting a subset of the data streamimmediately). In some examples, the gateway discards a subset of thedata stream (e.g., does not store the subset in the file (data file) tobe transmitted to the server device. In some examples, the gatewaystores the data stream or a subset of the data stream locally (e.g.,instead of transmitting the data stream to the server device). In someembodiments, the gateway transmits a subset of the data stream to theserver device responsive to a request (e.g., specifying particular typesof events, errors, malfunctions, etc.) from the server device (e.g.,otherwise the gateway stores and/or discards data). In some embodiments,the gateway dynamically configures what data is transmitted (e.g., basedon bandwidth, storage, cost, etc.). In some embodiments, the gatewaytransmits and/or stores the data that changes (e.g., changes over time,varies from a schedule, that is not redundant, changes from last stateof interest, reportable change, anomalous behavior, manually overridinga tinting schedule, etc.).

In some embodiments, one or more of a corresponding tint selector 120,driver 104, one or more EC windows 130, occupancy sensor, etc. arelocated in each unit (e.g., townhome, apartment, portion ofprefabricated building, portion of modular building) and a commongateway 106 is located in a central location (e.g., hallway, mechanicalroom, etc.). Thread range extenders may be used for the common gateway106 to communicate with the other components. A user may have access toa user account and a tint selector that only control EC windows 130corresponding to the unit to which the user has access.

In some embodiments, one or more components (e.g., gateway 106, sensorhub 126, etc.) of the electrochromic window system 100 may have two ormore network connections. In some examples, two or more wired networkconnections (e.g., each corresponding to a different network) may berouted to the same component. In some examples, a wired networkconnection and a wireless network connection (e.g., each correspondingto a different network) may be provided to the same component. In someexamples, two or more wireless network connections (e.g., eachcorresponding to a different network) may be provided to the samecomponent. A first network may be a primary network (e.g., cablenetwork, Ethernet network, etc.) and a second network may be a cellmodem backup network (e.g., integrated cellular modular in the cabinet).The cabinet 108 may have a router for receiving the different networkconnections. The one or more networks to which components of theelectrochromic window system 100 are connected may be separate fromother building networks.

In some embodiments, one or more components (e.g., gateway 106, sensorhub 126, etc.) of the electrochromic window system 100 transmit andreceive data via the network that is functioning (e.g., if the primarynetwork is down, the cell modem backup network is used). In someembodiments, one network (e.g., cable network) has a lower price than abackup network (e.g., cell modem backup network). The components of theelectrochromic window system 100 may send higher priority data viawhichever network is functioning and may wait until the lower-pricenetwork is functioning to transmit lower priority data. In someembodiments, one or more components (e.g., gateway 106, sensor hub 126,etc.) of the electrochromic window system 100 are aware of which networkconnection is functioning. In some embodiments, one or more components(e.g., gateway 106, sensor hub 126, etc.) of the electrochromic windowsystem 100 transmit a message to the cloud computing system 110 (e.g.,requesting via which network the cloud computing system 110 is receivingthe message) and the cloud computing system 110 may provide a responseindicating via which network (e.g., hardwired network or cellularnetwork) the message was received. The component of the electrochromicwindow system 100 may determine which network is functioning based onthe response.

In some embodiments, one or more components of the electrochromic windowsystem 100 use wireless power (e.g., wireless power transfer (WPT),non-wired power). The wireless transfer of power may be via induction(e.g., electromagnetic induction, inductive coupling of magnetic fields,non-radiative induction), resonance (e.g., radiative electromagneticresonance, resonance induction), radio frequency (RF) power transfer(e.g., uncoupled RF wireless power transfer), microwave power transfer,and/or laser power transfer. For example, a driver may wirelesslytransmit power to an EC window 130.

In some embodiments, one or more of the EC windows 130 are photovoltaic(PV) windows (e.g., PV EC windows) that include a PV coating coupled toa battery. The PV coating may collect energy from the sun and charge thebattery. The battery, wireless power, and/or an external power supply(e.g., via one or more drivers, via distributed EMS, etc.) may be usedto tint the EC window (e.g., the battery may be used first and then oneor more drivers may be used as a backup power supply).

FIG. 2 is a block diagram of an electrochromic window system 200 (e.g.,smart window system) including an automated control module 224 and abroker module 222, according to certain embodiments. Components with thesame reference number as those in FIG. 1 may include similar or the samefunctionalities as those described in relation to FIG. 1 . One or moremodules, functionalities, data stores, etc. of cloud computing system110 may be provided by a third party service. In some embodiments, thebroker module 222 may be provided by a third party (e.g., a third partyon-demand cloud computing platform provider). In some embodiments, thebroker module 222 is provided by the same entity that provides theautomated control module 224. In some embodiments, the automated controlmodule 224 is a single module that operates on the cloud computingsystem 110. In some embodiments, the automated control module 224includes two or more modules (e.g., two or more microservices, two ormore applications). In some embodiments, the automated module 224includes two or more modules (e.g., two or more microservices). Forexample, the automated module 224 (e.g., logic, schedules, trainedmachine learning model, a retrained machine learning model, etc.) may bedeployed at the gateway 106. Components of the electrochromic windowsystem 200 may have a wired and/or wireless connection to one or moreother components of the electrochromic window system 200. For example,the gateway may have a wired and/or wireless connection to one or moreof the distributed EMS 102, one or more drivers 104, sensor hub 126,exterior sensor 216, interior sensor 206, tint selector 120, and/or oneor more EC windows 130. Each of the components of the electrochromicwindow system 200 may have one or more wireless interfaces, one or morewired interfaces, or any combination thereof. For example, one or morecomponents of the electrochromic window system 200 may include one ormore radios, one or more wired transceivers (e.g., UniversalAsynchronous Receiver/Transmitter (UART), power line communication (PLC)transceiver), or the like. One or more components (e.g., drivers 104,the gateway 106, the tint selector 120, or the like) of theelectrochromic window system 200 may communicate over one or more wiredconnections or even over power lines.

One or more modules, functionalities, data stores, etc. of cloudcomputing system 110 may be provided by a third party service. In someembodiments, the broker module 222 may be provided by a third party(e.g., a third party on-demand cloud computing platform provider). Insome embodiments, the broker module 222 is provided by the same entitythat provides the cloud computing module 224. In some embodiments, theautomated module 224 is a single module that operates on the cloudcomputing system 110. In some embodiments, the automated control module224 may include one or more applications and one or more servers.

The electrochromic window system 200 may include the cloud computingsystem 110 and components including one or more of drivers 104, one ormore gateways 106, EC windows 130 (e.g., PV EC windows, battery coupledto PV coating, etc.), distributed EMS 102, tint selector 120, interiorsensors 206, sensor hub 126, exterior sensors 216, etc. The cloudcomputing system 110 may include the automated control module 224 andthe broker module 222. The automated control module 224 may identify,send instructions to, and receive data from the components of theelectrochromic window system 200 (e.g., via broker module 222).

The cloud computing system 110 is coupled to one or more gateways 106, asensor hub 126, a dashboard web app 140, and a dashboard mobile app 142.Each gateway 106 may be coupled via a corresponding wireless meshnetwork to drivers 104, interior sensors 206 (e.g., occupancy sensor122, occupancy sensor interface and thread range extender 138, etc.),one or more tint selectors 120, and the distributed EMS 102. The gateway106 may include characteristics of one or more of a hub, proxy, oraggregator. A sensor hub 126 may be coupled to one or more exteriorsensors 216. The drivers 104, distributed EMS 102, tint selector 120,and interior sensors 206 may be disposed proximate the gateway 106(e.g., within the building, within range of the wireless mesh network,etc.). The interior sensors 206 may include one or more of interiorlight sensors, a sensor on a window to collect EC window 130transmittance data, sensors to collect photographic data from interiorof building, occupancy sensors, etc. The exterior sensors 216 may bedisposed proximate sensor hub 126 (e.g., proximate the roof of thebuilding, on the roof, proximate the edge of the roof, etc.). Theexterior sensors 216 may include one or more of light sensors on thesides of buildings, temperature and/or humidity sensors, sensors (orcameras) to collect photographic data of cloud cover (or irradiance),irradiance sensor, rooftop pyranometer sensor (e.g., measure totalglobal irradiance, measure diffuse horizontal irradiance (shadowedlight, diffuse horizontal irradiance (DHI)), calculate direct normalirradiance, include non-visible spectrum), etc. DHI may refer to theterrestrial irradiance received by a surface (e.g., horizontal surface)which has been scattered or diffused by the atmosphere. DHI may be acomponent of global horizontal irradiance which may not come from thebeam of the sun (e.g., beam may be about a 5-degree field of viewconcentric around the sun).

In some embodiments, a sensor (e.g., interior sensor 206, exteriorsensor 216) transmits sensor data to the gateway 106. For example, oneor more exterior sensors 216 (e.g., camera, temperature sensor,illuminance sensor, humidity sensor, pressure sensor, rain sensor, orthe like) may be mounted on the roof and may transmit data (e.g., sensordata, images, etc.) to the gateway 106. In some embodiments, an exteriorsensor 216 is coupled (e.g., wirelessly, wired, etc.) with the gateway106 (e.g., without use of a sensor hub 126). In some embodiments, anexterior sensor 216 communicates with cloud computing system 110 (e.g.,without use of a sensor hub 126, without use of gateway 106). In someembodiments, a sensor (e.g., interior sensor 206, exterior sensor 216)has a wireless module to be able to communicate with the cloud computingsystem 110 and/or other components (e.g., sensor hub 126, gateway 106,etc.). In some embodiments, one or more exterior sensors 216 and asensor hub 126 may be integrated into a single component that has thefunctionalities of exterior sensors 216 and the sensor hub 126.

Each gateway 106 may be coupled, via a corresponding wireless meshnetwork, to corresponding drivers 104 that control corresponding ECwindows 130. For example, gateway 106 a may be coupled, via a firstwireless mesh network, to drivers 104 a that control EC windows 130 aand gateway 106 b may be coupled, via a second wireless mesh network, todrivers 104 b that control EC windows 130 b (e.g., the EC windows 130span more than one wireless mesh network). The drivers 104 a may becoupled to a gateway 106 a and drivers 104 b to gateway 106 b because ofcapacities (e.g., capacity of each gateway 106, cabinet 108, distributedEMS 102, wireless mesh network, etc.), length of cables, etc.

In some embodiments, the automated control module 224 may generate anobstruction map based on one or more of an image, dimensions, or a 3Dmodel (e.g., see FIGS. 3B-D). The automated control module 224 mayreceive a sun map or sun position table indicating the position of thesun at different times of each day. The automated control module 224 mayreceive propagation information indicating what portions of each roomcorresponding to an electrochromic device may receive direct sunlight.The automated control module 224 may store a corresponding obstructionmap, sun map, and propagation information for each electrochromicdevice. The automated control module 224 may receive (e.g., via brokermodule 222) sensor data via the sensor hub 126 from one or more exteriorsensors 216. The automated control module 224 may use the same sensordata for multiple electrochromic devices in the same area (e.g., samebuilding, neighboring buildings, etc.).

In some embodiments, the automated control module 224 may generate oneor more of an obstruction map, allowable sunlight map, reflection map,illuminance value, or the like. For each electrochromic device, theautomated control module 224 may determine, based on a correspondingobstruction map, a corresponding sun map, corresponding propagationinformation (e.g., allowable sunlight map), corresponding reflectionmap, corresponding illuminance value, and/or sensor data, a tint level(e.g., tinted or untinted, etc.) of a corresponding electrochromicdevice. For example, responsive to determining direct sunlight will notenter any portion of a room where sunlight is not allowed (e.g., onoccupants, desks, monitors, etc.), the automated control module 224 maydetermine the corresponding electrochromic device is to be untinted.Responsive to determining direct sunlight will enter a portion of a roomwhere sunlight is not allowed, the automated control module 224 maydetermine the corresponding electrochromic device is to be tinted.

The automated control module 224 may transmit tint instructions (e.g.,via broker module 222) to a corresponding gateway 106 and the gateway106 is to instruct the corresponding driver 104 to change the tint levelof a corresponding electrochromic device 130 based on the instructions.

FIGS. 3A-D are flow diagrams of methods for providing control of anelectrochromic device using an obstruction map (e.g., performingautomated control), according to certain embodiments. The methods 300A-Dcan be performed by processing logic that can include hardware (e.g.,processing device, circuitry, dedicated logic, programmable logic,microcode, hardware of a device, integrated circuit, etc.), software(e.g., instructions run or executed on a processing device), or acombination thereof. In some embodiments, the methods 300A-D areperformed by the cloud computing system 110 of FIG. 1 or FIG. 2 . Insome embodiments, the methods 300A-D are performed by one or more serverdevices of the cloud computing system 110. In some embodiments, themethods 300A-D are performed by a processing device of the cloudcomputing system 110 (e.g., a non-transitory machine-readable storagemedium storing instructions which, when executed cause a processingdevice to perform methods 300A-D). In some embodiments, the methods300A-D are performed by an automated control module 224 of the cloudcomputing system 110. In some embodiments, one or more portions ofmethods 300A-D are performed by one or more other components (e.g.,gateway, etc.). For example, the server device may transmit one or moreof an obstruction map, projection information, sun map, or sensor datato the gateway and the gateway may use the one or more of obstructionmap, projection information, sun map, or sensor data to control anelectrochromic device.

Although shown in a particular sequence or order, unless otherwisespecified, the order of the processes can be modified. Thus, theillustrated embodiments should be understood only as examples, and theillustrated processes can be performed in a different order, and someprocesses can be performed in parallel. Additionally, one or moreprocesses can be omitted in various embodiments. Thus, not all processesare required in every embodiment. Other process flows are possible.

Referring to FIG. 3A, the method 300A begins at block 302 by theprocessing logic generating an obstruction map that indicates anobstructed portion and/or an unobstructed portion of sky as viewed froman electrochromic device. For example, from the viewpoint of anelectrochromic device looking outside, the obstructed portion maycorrespond to a first portion of the electrochromic that is obstructed(e.g., by a building overhang, one or more buildings, a tree, etc.) fromreceiving direct sunlight. The obstruction map may be generated for anelectrochromic device (e.g., electrochromic device 402 of FIG. 4A) by aphotographic method (e.g., method 300B of FIG. 3B; see FIGS. 4B-R), ageometric method (e.g., method 300C of FIG. 3C; see FIGS. 4S-T), and/ora ray-tracing method (e.g., method 300D of FIG. 3D; see FIG. 4U).

The processing logic may generate the obstruction map in an image-basedformat (e.g., image projection format) that has angular maps of solarobstructions (e.g., characterize angular locations of exteriorobstructions that cause shadows on an electrochromic device). Exteriorshading obstructions (e.g., solar obstructions) may include buildingattachments (e.g., overhangs and fins) or site obstructions (e.g.,neighboring buildings, trees). The image based storage format may use anangular representation with azimuth angle for the x-axis and profileangle for the y-axis. The image format may preserve lines that areorthonormal to a vector perpendicular to the electrochromic device(e.g., perpendicular to a façade).

The processing logic may generate (e.g., using the photographic,geometric, and/or ray tracing methods) the obstruction map in an imageprojection format. In some embodiments, the obstruction map is in aformat for representing panoramic views. In some embodiments, theobstruction map is in a wide angle projection (e.g., preserve straightlines or object shape). In some embodiments, the obstruction maprepresents a full hemisphere (e.g., fisheye projection, sphericalprojection). In some embodiments, the obstruction map uses anequi-rectangular projection (e.g., spherical photo, non-verticalstraight lines in physical space represented as curves in the image). Insome embodiments, the obstruction map uses a double projection format toimprove appearance of straight lines in a hemispherical projection(e.g., non-vertical straight lines represented as curves). In someembodiments, the obstruction map is an equi-rectangular image that isconverted into a unit cube set of images to more easily identifystraight lines (e.g., six images of a unit cube project may preservestraightness of lines, the format may use six angle bases). In someembodiments, content-adaptive projection methods may be used to preservestraight lines in the obstruction map based on content. In someembodiments, the obstruction map is in an orthonormal pseudo-cylindricalformat. The orthonormal pseudo-cylindrical projection maintainsstraightness of orthonormal geometry. The straight lines make it easierto identify and trace edges between obstructions and sky. The projectionalso appears more natural visually compared to other formats. In someembodiments, the obstruction map is in an equirectangular format. Insome embodiments, the obstruction map uses the same format as thereflection map.

The image-based solar obstruction map relates obstructions relative tothe electrochromic device. By using coordinates of the electrochromicdevice as a reference, the orientation of the electrochromic device,site coordinates, and time parameters may be excluded from the solarobstruction map. One benefit is that the orientation of the window couldbe changed without affecting the obstruction map if the buildingorientation was incorrectly determined or if the site latitude andlongitude were incorrectly assigned (e.g., errors with orientation, suchas from incorrect north arrows on drawings). An obstruction map thatdoes not include time-based schedule formats for obstructions may not beinvalidated if a parameter, such as window orientation, was incorrectlyapplied (e.g., due to error in orientation, such as from an incorrectnorth arrow on a drawings).

The image-based obstruction format also allows the blending of mapsgenerated from various methods and data. Boolean operations on pixelvalues can be used to combine obstruction maps. For example, thephotographic method could be used to generate an obstruction map for anurban context and the geometric method could be used to generate anobstruction map for an overhang. These two maps can be added together togenerate a map that accounts for both overhang and neighboringbuildings.

The obstruction map in the image projection format (e.g., orthonormalpseudo-cylindrical projection) may preserve straightness of linesorthonormal to the view direction, which may be useful for storing andquerying the characterized solar obstructions. The straight lines maymake it easier to identify and trace edges between obstructions and sky.The projection may appear more natural visually compared to otherformats.

Obstructions may be defined as profile angle and azimuth angle cutoffs(e.g., since many cities are organized around a street grid). While aprojection formats may have straight vertical lines for azimuthal anglecutoffs, the orthonormal projection adds straight horizontal lines forprofile angle cutoffs. The sun path crosses a pixelated horizontal orvertical line once as compared to crossing a pixelated curved linemultiple times.

The processing logic may use the obstruction map in the image-basedformat for storing and for querying solar obstructions. In someembodiments, the processing logic generates the obstruction map based ontwo or more of an image, obstruction dimensions, or a 3D model. In someembodiments, the processing logic receives the obstruction map (e.g.,the obstruction map may be generated by another component).

Referring to FIG. 4A, an obstruction map may be generated for anelectrochromic device 402 that is shaded by one or more obstructions 404(e.g., overhang 404A, obstruction 404B to the side of the electrochromicdevice 402, neighboring buildings, tree, etc.). The electrochromicdevice 402 may be part of a façade and the processing logic may generateor receive an obstruction map for each electrochromic device in thefaçade (e.g., each electrochromic device of a 3×3 grid of electrochromicdevices).

The obstruction map may be from the vantage of electrochromic device 402looking outside. For example, the processing logic may generate theobstruction map using one or more images captured by a camera 406 ofFIGS. 4B-C from the viewpoint (e.g., vantage) of the electrochromicdevice 402 (e.g., looking outward, see FIG. 4C).

An obstruction map generated by the photographic method is illustratedin FIG. 4Q. An obstruction map generated by the geometric method isillustrated in FIG. 4T. An obstruction map generated by the ray-tracingmethod is illustrated in FIG. 4U. As illustrated in FIG. 4V, there maybe differences between a photographic obstruction map (e.g., anobstruction map generated using the photographic method of FIG. 3B), thegeometric obstruction map (e.g., an obstruction map generated using thegeometric method of FIG. 3C), and the ray-traced obstruction map (e.g.,an obstruction map generated using the method in FIG. 3D).

In some embodiments, the processing logic may generate the obstructionmap by combining obstruction maps generated by different methods.Responsive to user input that glare is to be minimized, the processinglogic may combine the obstruction maps to maximize the unobstructedportion of the obstruction map (e.g., if any obstruction map indicatesdirect sunlight may enter the electrochromic device, the processinglogic causes the electrochromic device to be tinted). Responsive to userinput that natural light is to maximized, the processing logic maycombine the obstruction maps to maximize the obstructed portion of theobstruction map (e.g., if any obstruction map indicates direct sunlightmay be obstructed from entering the electrochromic device, theprocessing logic causes the electrochromic device to be untinted). Insome embodiments, the processing logic may receive user input toidentify which portions of which obstruction maps to use.

Each method (e.g., methods 300B-D) may have intrinsic assumptions thatmay cause discrepancies. The first row of FIG. 4V illustrates thephotographic and ray-traced obstruction maps. The difference betweenmaps is shown in the middle between the maps, with the differenceshighlighted (e.g., in a darker shade). A difference in the first row isthe neighboring buildings at the bottom of the photographic obstructionmaps. The model used for ray-tracing did not contain the buildings, sothe lack of neighboring buildings is expected. There is anotherdifference along the right edge of the overhang, which could stem fromone or more of a slight model error in the 3D model for ray-tracing,positioning difference between the camera in the physical space, and/orthe origin used for rays in the virtual space.

The photographically and geometrically generated maps in the second rowof FIG. 4V have the most discrepancies of all of the map comparisons.First, the geometric obstruction map only contains the jamb and overhangobstructions (e.g., the geometric method may only accept parameters forthe electrochromic device and building overhangs). The façade to theleft of the window is not incorporated in the geometric obstruction map.This element could be included in the geometric map by adding supportfor a fin shading geometry. Neighboring buildings may be too complex tobe handled with an analytical obstruction map generator (e.g.,neighboring buildings may be limited to ray-tracing or photographicmethods). A more substantial difference occurs along the right edge ofthe overhang, where the geometric obstruction map has a different edgeangle from both the ray-tracing and the photographic maps. FIG. 4Willustrates a rendering of the façade with the sun located in the regionof discrepancy between obstruction maps. The rendering shows that asmall part of the window receives direct sunshine, demonstrating thatthe geometrically derived map may be correct. Both the ray-traced andphotographic methods used the lower corners of the electrochromic deviceto determine if the electrochromic device is shaded by the overhang. Therendering of FIG. 4W illustrates that both corners are shaded.Conversely, the cutoff angle methods used by geometric obstruction mapgenerator effectively identifies when sunlight shines under the edge ofthe overhang onto any part of the electrochromic device.

The photographic and ray-tracing methods may be enhanced to betteridentify the spill light by considering multiple points along the bottomedge of the electrochromic device. Alternatively, a hybrid method coulduse the photographic map or ray-traced map for far-field obstructionssuch as neighboring buildings and overlay a second map generated withthe geometric method for near-field obstructions such as buildingattached shading (overhangs and fins).

Returning to FIG. 3A, at block 304, the processing logic receives a sunmap indicating the position of the sun relative to the electrochromicdevice (e.g., trajectory of the sun at different times of the day anddifferent days of the year).

For example, FIG. 4X is a sun map (e.g., sun path) overlaid on anobstruction map using an equi-rectangular projection. The façadeorientation may be 4 degrees east of south. The top dotted line may bethe path of the sun on June 20, the bottom dotted line may be the pathof the sun on December 21^(st), and the middle dotted line (fourth fromtop and fourth from bottom) may be the path of the sun on March 21^(st).Pixilation of the curved obstruction may cause the sun's path to crossbetween unobstructed (e.g., white) and obstructed (e.g., black) severaltimes.

In another example, FIG. 4Y is a sun path overlaid on an obstruction mapusing an orthonormal pseudo-cylindrical projection. The configurationmay be the same as FIG. 4X. In the zoomed portion to the right of FIG.4Y, the sun path crosses from white to black a single time. Since theoverhang is a horizontal line in this projection, pixilation does notresult in many crossings between white and black.

Many obstructions may be defined as profile angle and azimuth anglecutoffs, since many cities are organized around a street grid. Whilemost projection formats have straight vertical lines for azimuthal anglecutoffs, the orthonormal pseudo-cylindrical projection adds straighthorizontal lines for profile angle cutoffs. The sun path may cross at apixelated horizontal or vertical line once (e.g., FIG. 4Y), but maycross a pixelated curved line multiple times (e.g., FIG. 4X).

Returning to FIG. 3A, at block 306, the processing logic receivespropagation information (e.g., allowable sun map, allowable directsunlight map, a map of allowable sun zones in a room) indicating one ormore portions of a room corresponding to the electrochromic device wheredirect sunlight is allowed.

In some embodiments, the propagation information is provided via aphotographic method. For example, the camera 406 of FIGS. 4B-C maycapture one or more images from the viewpoint of the electrochromicdevice 402 looking into the corresponding room. For example, in FIG. 4Z,an image is captured of the interior of the room (e.g., photographfacing into the space) from the vantage of the electrochromic device 402of FIG. 4A. The processing logic may identify allowable sunlight zones(e.g., floor, etc.) and/or unallowable sunlight zones (e.g., desks,seating areas, monitors, screens, etc.) in the image. The processinglogic may receive user input tracing the allowable sunlight zones (e.g.,a traced polygon). For example, the image in FIG. 4Z illustrates a photofacing into the space that has been traced to identify zones wheresunlight would be allowed. The allowable sun map may be similar informat to the obstruction map. FIG. 4Z also illustrates the tracedpolygon (e.g., allowable sun map) that has been flipped vertically forthe solar angles to correspond to those of an obstruction map.

In some embodiments, the propagation information is provided via ageometric method. Dimensions may be received of a distance from theelectrochromic device (e.g., three feet into the room from theelectrochromic device) and/or a height (e.g., three feet into the roomand two feet off of the floor) where direct sunlight is allowed.

In some embodiments, the propagation information is provided via a 3Dmodel. A 3D model may be created that includes zones within a room wheresunlight is allowed and/or zones where sunlight is not allowed. Forexample, the 3D model may indicate zones for hallways (e.g., sunlightallowed) and zones for seating, screens, etc. (e.g., sunlight notallowed).

Returning to FIG. 3A, at block 308, the processing logic receives sensordata (e.g., indicating direct sunlight, no direct sunlight, illuminancevalue, etc.) from one or more sensors (e.g., exterior sensors, interiorsensors).

At block 310, the processing logic determines, based on one or more ofthe obstruction map, the propagation information, the sun map, or thesensor data, a desired tinting state of the electrochromic device. Inblock 310, the processing logic may further determine the desiredtinting state based on a reflection map, illuminance values, and/or thelike. In some embodiments, the processing logic generates tintingschedules (e.g., shadow schedules based on the obstructions and suntrajectory) by querying the obstruction map with solar angles. Theobstruction map may be queried in advance to generate a schedule fortinting the electrochromic device or the obstruction map may be queriedin real-time to determine tint levels of an electrochromic device.

In some embodiments, the processing logic may overlay an obstruction map(e.g., FIG. 4V) on an allowable sun map (e.g., FIG. 4Z) (e.g., togenerate a composite map) and determine whether the position of the sun(e.g., FIGS. 4X-Y) is where direct sunlight is allowed (e.g., locatedwithin an obstructed portion of the obstruction map or an allowablesunlight zone of the allowable sun map). The processing logic maydetermine, using the sensor data, whether there is direct sunlight.

In some embodiments, the processing logic may minimize frequentswitching of tint levels. The processing logic may determine there is nodirect sunlight for a threshold amount of time before untinting theelectrochromic device (e.g., avoid untinting for a rapidly passingcloud, perform untinting responsive to a longer-lasting cloud cover).The processing logic may untint the electrochromic device responsive todetermining that the position of the sun is to correspond to directsunlight being allowed (e.g., located within an obstructed portion ofthe obstruction map or an allowable sunlight zone of the allowable sunmap) for a threshold amount of time (e.g., not untint if the sun isquickly passing through a small obstructed portion or small allowablesunlight zone).

In some embodiments, the processing logic receives further instructionsfor determining a tint level for the electrochromic device. Theprocessing logic may receive instructions from a building managementsystem, a building security system, a tint selector 120, a dashboardmobile app 142, a dashboard web app 140, etc. For example, responsive tothe building being in heating mode (e.g., during winter months), theprocessing logic may receive instructions from the building managementsystem to maximize untinting of electrochromic devices (e.g., responsiveto direct sunlight being obstructed, control the electrochromic windowsto be at a 0% tint level (highest transmittance)) to improve heat gainfrom sunlight and reduce the energy required to heat the building.Responsive to the building being in cooling mode (e.g., summer months),the processing logic may receive instructions from the buildingmanagement system to maximize tinting of electrochromic devices (e.g.,responsive to direct sunlight being obstructed, control theelectrochromic windows to be at 50% tint level (mid-leveltransmittance)) to reduce heat gain from sunlight to reduce the energyrequired to cool the building. In some embodiments, the processing logicreceives instructions from the dashboard mobile app 142 or dashboard webapp 140 of tint levels (e.g., 0% tint level, 50% tint level, 100% tintlevel, etc.) to be used when direct sunlight is obstruction and whendirect sunlight is not obstructed (e.g., 75% tint level when directsunlight is not obstructed, 5% tint level when direct sunlight isobstructed, etc.).

Returning to FIG. 3A, at block 312, the processing logic causes acurrent tinting state of the electrochromic device to correspond to thedesired tinting state. For example, the processing logic may use theobstruction map to tint an electrochromic device at the time that thesun comes above a neighboring building, and then to untint theelectrochromic device when the sun passes behind an overhang. Theprocessing logic may cause the electrochromic device to be set at a tintlevel (e.g., tinted, untinted) by transmitting instructions to thegateway to control the driver coupled to the electrochromic device.

Referring to FIG. 3B, the method 300B may be a photographic method forgenerating an obstruction map

At block 322, the processing logic receives a first image of sky andobstruction exterior to an electrochromic device from a viewpoint of theelectrochromic device (e.g., a first image taken from a first viewpointof the electrochromic device, looking outside). In some embodiments, theprocessing logic receives multiple images (e.g., a first image proximatea left corner of the electrochromic device and a second image proximatea right corner of the electrochromic device) and combines the imagesinto a single image.

A camera 406 (e.g., see FIGS. 4B-C) may be used to generate obstructionmaps for an electrochromic device (e.g., electrochromic device 402 ofFIG. 4A). For example, the processing logic may use a calibrated lensand camera 406 to generate solar obstruction maps in situ by takingphotos from the vantage of the electrochromic device. The camera 406 mayuse a sensor and a lens. The lens may be a circular fisheye lensproviding a full 180-degrees both horizontally and vertically. A shroud(e.g., square, black shroud) may be placed around the camera 406 toallow the camera 406 to be placed directly against the electrochromicdevice (e.g., against the glass, against a transparent portion of theelectrochromic device) when capturing images, aligning the camera 406with the plane of the electrochromic device. The shroud may alsominimize reflections on the electrochromic device (e.g., on the glass ofthe window).

The camera 406 may include or be attached to an accelerometer (e.g.,three-axis accelerometer) and a magnetometer on a board (e.g., breakoutboard). The accelerometer may sense the gravity vector relative to thecamera 406. The gravity vector may be used to calculate the tilt androtation of the camera 406. Rotation may be introduced by the camera 406not being level (e.g., the operator not holding the camera 406 perfectlylevel). The rotation measured with the accelerometer may be used tocorrect non-level camera positions by rotating the fisheye image theopposite direction. If the camera 406 is held flat against a verticalelectrochromic device, the tilt may be zero. The accelerometer on thecamera 406 may be used to measure electrochromic device tilt ofnon-vertical electrochromic devices.

FIG. 4D is a graph illustrating a polynomial fit to an observed angulardistortion of the camera 406 and lens, according to certain embodiments.Angular distortion of a camera 406 may be characterized by a calibrationmethod. The calibration method may include mounting the camera 406 to astepper motor and capturing images of a small light source. The steppermotor may turn the camera 406 in discrete angles between photos. Thepixel position of the light source may be measured in each image andcompared to the rotation of the camera 406. FIG. 4D illustrates therelationship between rotation of the camera 406 and light source pixelposition. A polynomial fit of observed angular distortion may be used tocorrect a fisheye image to an equiangular fisheye image. In someembodiments, calibration method includes starting with the light sourcein the center of the image and the camera turned so the light sourcetravels to the edge in the image. This may be performed multiple times(e.g., four times) with the camera itself turned 90 degrees, so thelight source traveled in four directions in the image (e.g., up, down,left, and right). The pixel position of the light source may be measuredin each photo and compared to the rotation of the camera. FIG. 4Dillustrates a graph showing the relationship between camera rotation andlight source pixel position for the texts (e.g., all four tests). Asillustrated in FIG. 4D, there may be slight differences between camerarotations. The results may be rather symmetric. A polynomial fit ofobserved angular distortion may be used to correct fisheye photos to anequiangular fisheye. FIGS. 4E-G illustrate example images with rotationcorrection and angular distortion correction.

In some embodiments, a calibration method may be followed by one or morevalidation methods to validate the calibration of the camera 406. Insome embodiments, calibration and validation is performed once percamera 406. In some embodiments, over time, one or more components ofthe camera 406 (e.g., lens, image sensor, shroud, etc.) may start tointroduce error (e.g., due to one or more components shifting relativeto each other, one or more components becoming damaged, one or morecomponents undergoing wear and tear, etc.). If the camera 406 isstarting to show error, then calibration and validation be performedagain for the camera 406. If maintenance is performed on the camera 406(e.g., replacing one or more components, reconfiguring one or morecomponents, adjusting one or more components, etc.), then calibrationand validation may be performed again for the camera 406.

Calibration of the camera 406 may be performed first and then validationmay be performed. If the validation does not meet a threshold errorvalue (e.g., the camera has too high of error), then a corrective actionmay be performed, such as one or more of the camera 406 may bere-calibrated, the camera 406 may be replaced, one or more components ofthe camera 406 may be replaced, maintenance may be performed on thecamera 406, an alert may be provided to the user, or the like

Validation may include one or more validation methods. A first methodincludes photographing the sun and a second method includesphotographing the window.

The calibration method and validation methods can be performed byprocessing logic that can include hardware (e.g., processing device,circuitry, dedicated logic, programmable logic, microcode, hardware of adevice, integrated circuit, etc.), software (e.g., instructions run orexecuted on a processing device), or a combination thereof. In someembodiments, the calibration method and/or one or more of the validationmethods is performed by the cloud computing system 110 of FIG. 1 or FIG.2 . In some embodiments, the calibration method and/or one or more ofthe validation methods are performed by one or more server devices ofthe cloud computing system 110. In some embodiments, the calibrationmethod and/or one or more of the validation methods are performed by aprocessing device of the cloud computing system 110 (e.g., anon-transitory machine-readable storage medium storing instructionswhich, when executed cause a processing device to perform methods300A-D). In some embodiments, the calibration method and/or one or moreof the validation methods are performed by an automated control module224 of the cloud computing system 110. In some embodiments, one or moreportions of the calibration method and/or one or more of the validationmethods are performed by one or more other components (e.g., a localcomputing device, a local server device, a gateway, etc.). For example,the server device may transmit one or more of an obstruction map, sunmap, or sensor data to the local computing device and the localcomputing device may compare one or more images of the sun and/or one ormore images of the window to the obstruction map, sun map, and/or sensordata to validate the camera 406. In another example, the server devicemay receive one or more images of the sun and/or one or more images ofthe window (e.g., from a local device, from one or more imaging devices,etc.) and may compare the one or more images to the obstruction map, sunmap, and/or sensor data.

For the first validation method of photographing the sun, the samecamera 406 used for obstruction mapping may be used to capture images ofthe sun from a window (e.g., periodically, every 5 minutes, every 10minutes, etc.). A filter (e.g., several layers of neutral density (ND)filter gel) may be placed between the camera and the sun to reduce thequantity of light reaching the camera to prevent circumsolar regions ofthe image from being overexposed. The image may be processed in the sameway that images are prepared for obstruction maps, correcting forrotation and angular distortion and re-projecting into the orthonormalpseudo-cylindrical format. Because of the filter (e.g., ND filter), thesun may be the only noticeable feature in the image (e.g., the rest ofthe image appears black).

FIGS. 17A-B illustrate examples of one or more images captured of thesun using a camera, according to certain embodiments. The images ofFIGS. 17A-B may be captured by the same camera 406 that captures theimages for generating the obstruction map (e.g., to validate thecalibration of camera 406). To capture the images of FIGS. 17A-B, thecamera 406 may have multiple layers of neutral density filter gel. Theimage of FIG. 17A may be remapped into the orthonormalpseudo-cylindrical projection. The image of FIG. 17B may be an enlargedregion (e.g., ten times enlarged region) of the image containing the sun(e.g., image of FIG. 17A).

For analysis, the processing logic may convert the image of the sun tograyscale and may identify the pixels representing the sun by applyingthreshold values (e.g., identify with thresholding, identify withbrightness threshold values, etc.). The processing logic may identifythe centroid of the sun (e.g., using OpenCV, a computer vision softwarepackage). The processing logic may compare the position of the centroidof the sun in the image with the calculated position of the sun (e.g.,from the sun map) at that time and the difference may be reported foreach image. Expected sun position (e.g., sun map) may be calculatedusing a collection of libraries (e.g., using pysolar, an implementationof the solar position algorithm (SPA) from the National Renewable EnergyLaboratory (NREL)) for simulating the irradiation of any point on earthby the sun for precise ephemeris calculations (e.g., that is accuratewithin about 0.6 degrees).

For the second validation method of photographing the window, theprocessing logic may use the obstruction map (e.g., and sun map and/orsensor data) to determine what times sunshine on the window would beginand end. The processing logic may compare theseobstruction-map-determined times to observed times for the window. Theprocessing logic may monitor the window by capturing images periodically(e.g., every minute) via an imaging device. The specular nature of glassmay make observing incident sunshine on a window difficult, so thewindow may be covered with diffuse white paper to make incident sunlightmore visible.

FIGS. 18A-B illustrate examples of images 1800 captured of anelectrochromic device, according to certain embodiments. The images 1800may be used for the second validation method of photographing theelectrochromic device. In some embodiments, the electrochromic device iscovered (e.g., with diffuse paper, with diffuse white paper, with whitepaper, etc.). FIG. 18A illustrates an image 1800A of a coveredelectrochromic device (e.g., covered with paper) with the sun shining onthe electrochromic device. FIG. 18B illustrates an image 1800B of acovered electrochromic device without sun shining on the electrochromicdevice. The images 1800 of the electrochromic device may be capturedusing any imaging device (e.g., camera 406, a camera other than camera406, etc.). In some embodiments, the images 1800 may include theelectrochromic device plus the area surrounding the electrochromicdevice (e.g., the images 1800 may be captured from the other side of theroom from the electrochromic device). In some embodiments, the images1800 may include the electrochromic device without the area surroundingthe electrochromic device (e.g., the imaging device may be located farenough away from the electrochromic device to capture just theelectrochromic device).

Results from the first validation method of photographing the sun mayinclude Table 1 of calculated and photographed sun position and error.

TABLE 1 Photo- Photo- WSA WSP Com- Day Calculated graphed graphed ErrorError bined and Sun Angle Centroid Sun Angle (de- (de- Error Time(degrees) Pixel (degrees) grees) grees) (degrees Date WSA WSP X Y WSAWSP 08:00 Date 1.61 13.38 182 153 1.25 13.25 −0.36 −0.13 0.38 08:10 Date3.20 15.36 185 149 2.75 15.25 −0.45 −0.11 0.46 08:20 Date 4.81 17.34 188145 4.25 17.25 −0.56 −0.09 0.57 08:30 . . . . . . . . . . . . . . . . .. . . . . . . . . .

The processing logic may calculate the values shown in Table 1. Table 1has a first column contains the date and time of the observation and thenext two columns are the calculated sun position angles. The followingtwo columns (photographed centroid pixel: X & Y) contain the pixelcoordinates of the sun's centroid from the photo. The processing logicmay convert the pixel coordinates into sun angles (e.g., using aninverse of obstruction map sampling code) and enter the sun angles intocolumns titled photographed sun angle. The last three columns containthe error between the photographed sun position and the calculated sunposition. A table may include more or less columns than those describedand illustrated here. One or more data structures other than a table maybe used. The WSA and WSP error columns may be the difference between thecalculated and photographed columns. The combined error may be the rootsum of squares of the two errors (e.g., the Euclidian distance of thediscrepancy in 2D coordinate space, specifically the orthonormalprojection).

In one example, the validation methods were run on an east facing façade(e.g., 4 degrees south of east) for a morning in September. An overhangabove the window and a neighboring building limited the time when thesun was visible to the camera to about three hours. A total of 19 photosof the sun were taken. The maximum error observed during the validationexercise was 0.6 degrees. The average combined error was 0.34 degrees.

The second validation method tests the accuracy of the manual tracingmethod in addition to the angular accuracy of the obstruction mappingcamera.

FIGS. 19A-F illustrate a series of images 1900 of an electrochromicdevice captured over time, according to certain embodiments. The images1900 may be captured in the same or similar manner as the images 1800 ofFIGS. 18A-B. The camera photographing the window may successfullycapture the first and last moment that sunshine is incident on thewindow (e.g., FIGS. 19B and 19E).

In some embodiments, FIGS. 19A-C illustrate images that capture thefirst moment that sunshine is incident on the window. For example, image1900A may have been captured at 7:41 am, image 1900B may have beencaptured at 7:42 am, and image 1900C may have been captured at 7:43 am(e.g., all on the same day). Image 1900B may illustrate the first silverof sunlight on the window.

In some embodiments, FIGS. 19D-F illustrate images that capture the lastmoment that sunshine is incident on the window (e.g., before beingobstructed). For example, image 1900D may have been captured at 11:02am, image 1900E may have been captured at 11:03 am, and image 1900F mayhave been captured at 11:04 am (e.g., all on the same day). Image 1900Emay illustrate the last silver of sunlight on the window.

Table 2 shows the obstruction map time and the observed time (e.g., fromthe second validation method of photographing the window) of sunshine onthe window (e.g., and the error between the two).

TABLE 2 Obstruction Observed Event Map Time Time Error WSP Error Sunbegins to shine  7:39  7:42 −3 min +0.5 degrees on the window Sunfinishes 11:06 11:03 +3 min −0.5 degrees shining on the window

The processing logic may be used to calculate the values shown in Table2. Both events occurred within 3 minutes of the expected time based onthe obstruction map. The beginning of sunshine on the window occurredthree minutes later than expected and the end of sunshine occurred threeminutes earlier than expected. In both cases, the event occurs when thesun passes a horizontal line in the obstruction map, so WSP angleaccuracy is considered in this case. The WSP accuracy during these timesin the first validation (−0.13 and +0.07 degrees) was much lower than inthe second validation method (+0.5 and −0.5 degrees). The obstructionmap may have been traced (e.g., by a user) acting conservatively withrespect to the glare, by erring on the side of more sunshine whentracing.

The first validation tested the angular accuracy of the obstructionmapping camera directly. The second validation tested the accuracy ofthe overall result for a window. These two validations show errors ofless than one degree. The resulting error in shade control actuationtime of three minutes can be overcome simply by deploying shading a fewminutes early and removing shading a few minutes late. This conservativeapproach also offers shading from the exceedingly bright circum-solarregion of the sky. These validation results show that the photographicmethod of mapping obstructions can be used for controllingelectrochromic windows.

FIGS. 4E-G illustrates sample images with rotation correction andangular distortion correction, according to certain embodiments. FIG. 4Emay illustrate a raw fisheye image, FIG. 4F may illustrate arotation-corrected fisheye image, and FIG. 4G may illustrate an angulardistortion corrected fisheye image.

In some embodiments, two or more images are captured to identifyobstructions of an electrochromic device. For example, a first image(e.g., FIG. 4H) captured from the left side of the electrochromic deviceand a second image (e.g., FIG. 4I) captured from the right side of theelectrochromic device. A first image captured from the left side mayprovide a better view of obstructions to the right side of theelectrochromic device and a second image captured from the right sidemay provide a better view of obstructions to the left side of theelectrochromic device. The height of the camera 406 for capturing theimage may depend on the control intent. For daylight and glare controlpurposes, the image may be captured from workplane height (e.g., ahorizontal plane situated at the nominal working height in an interiorspace, desk height, etc.) or if a bottom portion (e.g., the window sill)of the electrochromic device is above the workplane, from the height ofthe bottom portion (e.g., window sill height). Before capturing theimages, the camera rotation may be corrected using the gravity vector byrotating the image. The first and second images (e.g., left and rightimages, FIGS. 4H-I) may be stitched together into a single image afterre-mapping.

The image for generating the obstruction map may be an orthonormalpseudo-cylindrical image. For the orthonormal pseudo-cylindrical image,the pixels in the x-axis may be determined by an azimuthal angle with adirection perpendicular to the electrochromic device used as a reference(e.g., similar to equi-rectangular format). Azimuthal angle may bemeasured in a horizontal plane. For non-vertical electrochromic devices(e.g., tilting forward or backward), the azimuthal angle may be measuredin a plane perpendicular to the plane of the electrochromic device whoseintersection with the window is horizontal.

Pixels in the y-axis may also be equiangular, however instead of anelevation angle (e.g., used by the equi-rectangular projection), theorthonormal pseudo-cylindrical image may use a profile angle. A profileangle may be the angle between the electrochromic device perpendicularand a direction vector projected into a vertical plane perpendicular tothe electrochromic device.

FIG. 4J-K illustrate a comparison between the equi-rectangular (e.g.,FIG. 4J) and the orthonormal pseudo-cylindrical (e.g., FIG. 4K) imageprojections (e.g., rendered from inside a cube). Lines orthonormal tothe view direction vector retain linearity in the orthonormalpseudo-cylindrical projection, while only vertical lines retainlinearity in the equi-rectangular projection (e.g., horizontal linesbecome curved).

FIG. 4L illustrates a remapped hemispherical fisheye photo (e.g., fromFIG. 4E, 4F, or 4G) to equi-rectangular projection. FIG. 4M illustratesa remapped hemispherical fisheye photo (e.g., from FIG. 4E, 4F, or 4G)to orthonormal pseudo-cylindrical projection.

After images captured from the left and the right side of anelectrochromic device are converted to an orthonormal pseudo-cylindricalrepresentation, the images may be combined into a single image thatincludes the maximum horizontal viewable extend of the electrochromicdevice (e.g., see FIGS. 4N-P). The combination of two images may resultin duplication artifacts, particular for near field objects such as thecenter tree in the image, which appears as two trees in the combinedimage. Minor variations in the height of the camera may appear as stepchanges in the combined image, such as a bottom frame of theelectrochromic device in FIGS. 4N-P. The step change is generally notapparent for objects further from the lens, as exhibited by the line inthe concrete and the overhang edge.

FIGS. 4N-O illustrate photos taken from the left and right side of anelectrochromic device (e.g., from FIGS. 4H-I) remapped to an orthonormalpseudo-cylindrical projection. FIG. 4P illustrates FIGS. 4N-O combinedinto a single composite image.

Returning to FIG. 3B, at block 324, the processing logic identifies oneor more obstructed portions of the first image and/or one or moreunobstructed portions of the first image. In some embodiments, theprocessing logic may identify a first set of pixels (e.g., blue pixels)in the first image and determine that the first set of pixels correspondto an unobstructed portion (e.g., correspond to sky). In someembodiments, the processing logic may identify a second set of pixels(e.g., red pixels, non-blue pixels) in the first image and determinethat the first set of pixels correspond to an obstructed portion (e.g.,do not correspond to sky). In some embodiments, the processing logic mayreceive user input identifying (e.g., tracing) one or more of anobstructed portion or an unobstructed portion of the first image.

Images may be traced with a polygon drawing tool to generate a Booleanobstructed/unobstructed map for the electrochromic device. Only anglesabove the horizon may be used, so for vertical electrochromic devices,the obstruction map may be cut off below a profile angle of zerodegrees, resulting in a “half map” that covers half of a hemisphere.Skylights or tilted facades may use maps containing a profile anglebelow zero degrees, so a “whole map,” may be used that covers the entirehemisphere. FIG. 4Q is an example of a half map generated using thecomposite image from FIG. 4P. When tracing images, objects smaller thanthe electrochromic device (e.g., tree trunks) may be ignored. In someembodiments, other objects, such as deciduous tree canopies, may beignored. In some embodiments, season obstruction maps are generated fordeciduous tree canopies (e.g., that are sufficiently large and dense).

FIG. 4Q illustrates a polygon traced over the orthonormalpseudo-cylindrical image and a resulting black/white Boolean image mapwhere black represents obstructed sky and white represents unobstructedsky.

In some embodiments, the processing logic may identify obstructed and/orunobstructed regions in the image may via manual user input (e.g., andmay be accelerated with a custom workflow and toolkit). In someembodiments, the processing logic may identify the obstructed and/orunobstructed regions in the image via automation by employing computervision (CV) and machine learning (ML) techniques. For example, a machinelearning model may be trained using training input of images (e.g.,including indications of colors of pixels, such as blue pixels, etc.)and target output of an identification of obstructed and/or unobstructedregions of the images (e.g., polygon traced over the images). New imagesmay be provided to the trained machine learning model and an output maybe obtained from the trained machine learning model indicatingobstructed and/or unobstructed regions of the images (e.g., polygontraced over the images). In some embodiments, the output of obstructedand/or unobstructed regions may be verified by manual review forre-training of the machine learning model (e.g., based on the new imagesand the manual review of the obstructed and/or unobstructed regions).

Returning to FIG. 3B, at block 326, the processing logic generates theobstruction map based on the obstructed and/or the unobstructed portionof the first image.

The resulting obstruction map (e.g., black/white Boolean image map ofFIG. 4Q) may have a resolution equivalent to 0.5 degrees which may bethe approximate subtended angle of the sun. Resolutions finer than 0.5degrees may have quickly diminishing returns. Half-map image files maybe 360 pixels wide by 180 pixels tall. Full map image files may be 360pixels wide by 360 pixels tall.

For compactness, the image format may be portable network graphics (PNG)file format which may have a lossless compression (e.g., substantiallylossless, completely lossless, etc.) which may work well for images withlimited pixel colors. The half-map in FIG. 4Q may use 4 kilobytes (KB)in PNG format without losing or modifying any pixel data.

To determine whether or not the electrochromic device is currently in ashadow (e.g., determine whether the position of the sun corresponds toan obstructed portion of the obstruction map), the obstruction map maybe queried with the solar azimuth and profile angles of theelectrochromic device. For a vertical electrochromic device, the solarazimuth angle may be calculated from the solar azimuth angle and theorientation of the electrochromic device as follows:WSA=SA−WO  (1)

Where:

WSA=Window solar azimuth angle

SA=Solar azimuth angle (0=north, 90=east, 180=south, 270=west)

WO=Window orientation (0=north, 90=east, 180=south, 270=west)

Calculating the profile angle for a vertical electrochromic device fromsolar azimuth angle and solar elevation angle of the electrochromicdevice as follows:WSP=a tan 2(sin(SE),cos(WSA))  (2)

Where:

WSP=Window solar profile angle

WSA=Window solar azimuth angle (0=north, 90=east, 180=south, 270=west)

SE=Solar Elevation Angle

Electrochromic device azimuth (e.g., WSA) and electrochromic deviceprofile angles (e.g., WSP) for non-vertical electrochromic devices arecalculated by first applying a change of basis transformation to movethe solar angle into the a reference coordinate system defined by thewindow normal and window up vectors, after transforming the solar vectorinto the window reference space, the same equations above can be used tocalculate the electrochromic device solar azimuth and electrochromicdevice solar profile angles.

FIG. 4R illustrates a plot of queried solar positions overlaid on atraced image (e.g., traced image of FIG. 4Q). Querying a WSA of 32 andWPA of 32 would return false for sun obstructed. Querying a WSA of 44and a WPA of 62 returns true for sun obstructed.

In some embodiments, the automated control module 224 (e.g., shadowbased control) may use python and the imageio library (e.g., pythonlibrary for reading and writing image data). The image map (e.g.,obstruction map) may be read into a python array. Array indexing maycorrespond to the resolution of the obstruction map. When queried withthe electrochromic device solar azimuth and electrochromic deviceprofile angle, the automated control module 224 may convert the anglesto the nearest pixel index and may verify the brightness value of thepixel. If the brightness is below 5 (e.g., out of a 256 range for PNG),then the window is considered to be in a shadow (e.g., corresponding toan obstructed portion of the image).

In some embodiments, one or more exterior sensors (e.g., a rooftopsensor, camera, etc.) has un-obstructed view of the sky. The sensor datafrom the one or more exterior sensors may be used to determine whetherthe sun is shining. An obstruction map for a specific electrochromicdevice may indicate whether sunshine reaches the electrochromic devicefor the current sun position. By using obstruction maps, shading may notbe deployed for electrochromic windows that are in the shadow of anexternal obstruction. Obstruction maps may be provided for everyelectrochromic device individually or several obstruction maps may becombined logically so that a group of electrochromic devices can becontrolled together.

The image used to generate the obstruction map may be retained toprovide photographic record of context at the time of map generation forlater use. Having a visual record of the obstruction map may bebeneficial (e.g., for shading control companies that offer post-salesservice). The photographic record may be used to determine what in theobstruction map is working or not working (e.g., correctly orincorrectly causing the electrochromic devices to tint or untint) andthe photographic record may be compared to current conditions to see ifsomething has changed (e.g., a new building constructed, or a buildinghas been demolished).

The photographic method may allow characterizing complex contexts (e.g.,environments). For example, a residential neighborhood with pitchedroofs on tightly packed townhomes may be difficult to model and often isnot included in urban models for purchase, but could easily bephotographed to generate accurate solar obstruction maps. Other examplesof obstructions that can be characterized using the photographic method,but may otherwise be difficult to characterize are a grove of evergreentrees, a mountain range, a highway bridge, etc.

The photographic method offers the ability to generate obstruction mapsfor small projects. For example, an installation of automated shading ina restaurant with six windows in an urban context, may not justify thecost of creating a 3D model of the urban context for ray tracing.However, the photographic method for generating obstruction maps is alow cost and could be used.

In addition to or instead of the photographic method, the processinglogic may use one or more other methods for generating an obstructionmap. In some embodiments, the photographic method (e.g., method 300B)uses a calibrated fisheye lens and may be used for smaller projects. Thephotographic method may be quick and efficient for a small number ofelectrochromic devices. As the number of electrochromic devicesincreases, other methods such as geometry derivation (e.g., FIG. 3C) orray-tracing (e.g., FIG. 3D) may become more efficient methods forgenerating obstruction maps. A variety of methods for generatingobstruction maps may be available to a commissioning agent, allowing thechoice based on project specifics. Using a common format (e.g.,orthonormal pseudo-cylindrical format) for storing obstruction mapsallows simple methods for using obstruction maps regardless of how theobstruction maps are generated. Orthonormal pseudo-cylindricalobstruction maps may be generated using an analytic method or aray-tracing method. The analytic method (e.g., geometric derivation ofmethod 300C) may be used for well-defined obstructions such as overhangsand fins. The ray-tracing method (e.g., method 300D) may be used forlarger projects where a 3D model of the building an environment (e.g.,context) may be used.

Referring to FIG. 3C, the method 300C may geometrically derive anobstruction map (e.g., shading map, generating an obstruction map withgeometric analysis). Geometric derivation of obstruction maps may beuseful for common forms of building-attached shading elements, such asoverhangs, fins, cowls, louvers, etc. The commissioning workflow forgeometrically-derived obstruction maps may begin with dimensioninggeometric properties of the building, either by scaling from drawings ormeasuring in situ.

At block 342, the processing logic receives first dimensions of anelectrochromic device and second dimensions of obstructions of theelectrochromic device (e.g., geometries of the electrochromic deviceand/or obstructions). The first dimensions of the electrochromic devicemay include one or more of height, width, or thickness of theelectrochromic device. The second dimensions may include an overhang,height of the overhang above the electrochromic device, extension of theoverhang of one or more obstructions of the electrochromic device. Insome embodiments, the processing logic receives the first and seconddimensions via user input. In some embodiments, the processing logicreceives the first and second dimensions by processing a 3D model.

The processing logic may use an obstruction-map-generating functionspecific to the particular shading type to receive the providedgeometric dimensions to calculate various shading cutoff angles. Theprocessing logic may convert the cutoff angles into an obstruction mapin PNG format in orthonormal pseudo-cylindrical image format. As anexample, table 1 includes geometry parameters to be used to generate anobstruction map for an overhang.

TABLE 1 Geometry Parameter Description Overhang depth (OD) Distance fromthe facade to the overhang Overhang height above Distance from the topof the window to the window (OH) bottom of the overhang Window height(WH) Distance from the window sill to the window head Window width (WW)Distance from the left window jamb to the right window jamb Overhangextension left Distance from the left edge of the window to (OEL) theleft edge of the overhang (looking from inside out) Overhang extensionright Distance from the right edge of the window to (OER) the right edgeof the overhang (looking from inside out) Jamb Thickness (JD) Distancefrom the inside edge of the window jamb to the outside edge of thewindow jamb

FIG. 4S illustrates examples of obstruction maps that are geometricallyderived. The processing logic may use the input parameters shown in FIG.4S to generate obstruction map images shown in FIG. 4S. The black areaof the obstruction maps in FIG. 4S depicts sun positions where theelectrochromic device is completely shaded by the overhang geometry. Thestrips of black on the left and right of the image are azimuthal cutoffangles caused by the jamb thickness and window width.

Returning to FIG. 3C, at block 344, the processing logic generates anobstruction map based on the first dimensions and the second dimensions.FIG. 4T is an obstruction map image for the overhang above theelectrochromic device 402 of FIG. 4A. The obstruction map excludes theeffect of the façade wall perpendicular to the electrochromic device onthe left side and the effect of neighboring buildings. The obstructionmap of FIG. 4T is generated using the geometric method and FIG. 4Tincludes the parameters used by the processing logic (e.g., obstructionmap generating scrip) to generate the obstruction map.

Referring to FIG. 3D, method 300D may be for generating an obstructionmap with ray-tracing (e.g., using a 3D model). The 3D model may be a 3Dcomputer-aided-design (CAD) model of the project site. The processinglogic may generate or retrieve the 3D model. Control for solarobstructions may be an additional feature for a 3D model. The setup costof shadow modeling may be high due to the time required to prepare a 3Dmodel. Once the 3D model is setup, ray-tracing costs per window are low.Because of high setup cost and low per window costs, large projects mayjustify the cost of a 3D model. One or more of methods 300B-D maygenerate obstruction maps in a way that avoids high setup cost (e.g.,even with higher per window costs) to make obstruction-enabled controlaffordable for small projects.

At block 362, the processing logic receives a 3D model of environmentrelative to an electrochromic device. The 3D model may include theelectrochromic device and surrounding geometry, such as the buildingcorresponding to the electrochromic device, overhangs of the building,additional buildings proximate the electrochromic device, etc.

FIG. 4A may illustrate a simple 3D CAD model of an electrochromic device402 including window framing, overhang, and adjacent perpendicularfaçade. The processing logic may use ray-generating script to generatesample rays for sampling the geometry of the 3D model of FIG. 4A. Theray-generating script may take electrochromic device orientation andtilt, as well as coordinates for one or two points, to be used as rayorigins in the 3D model. If only one point is provided, all rays mayoriginate from that point. If two points are provided, rays in the leftdirection (e.g., negative façade azimuth angle) may originate from thefirst origin coordinates provided and rays in the right direction mayoriginate from the second origin coordinates provided. If the tilt ofthe electrochromic device is greater than or equal to 90 degrees, thescript may generate rays for a half map (e.g., profile angles from 0 to90 degrees) and if the tilt is less than 90, the script may generatesample rays for a full map (e.g., profile angles from −90 to 90degrees). The 3D model may be converted to a compatible file format andsample rays may then be traced. The resulting image may be converted toa PNG format.

Returning to FIG. 3D, at block 364, the processing logic generates anobstruction map based on the 3D model (e.g., for electrochromic device402 of FIG. 4A). FIG. 4U illustrates the obstruction map generated byray tracing the model shown in FIG. 4A. Elements included in the model(e.g., overhang, window jambs, and perpendicular façade) are included inthe obstruction map. Likewise, shading elements not included in themodel (e.g., neighboring buildings) are not included in the ray-tracedobstruction map.

Method 300A may use one or more of methods 300B-D to generate anobstruction map. In some embodiments, the obstruction maps generated bytwo or more of methods 300B-D are used to check for errors (e.g.,troubleshoot each other). For example, responsive to determining one ofthe obstruction maps has an error, an obstruction map may bere-generated using additional images in method 300B, using additionaldimensions in method 300C, or using additional elements and/or points inthe 3D model of method 300D.

FIG. 5 illustrates a diagrammatic representation of a machine in theexample form of a computer system including a set of instructionsexecutable by a computer system 500 for automated control of anelectrochromic window (e.g., using one or more of an obstruction map,allowable sunlight map, reflection map, illuminance value, or the like)according to any one or more of the methodologies discussed herein. Insome embodiments, computer system 500 includes one or more serverdevices of a cloud computing system (e.g., cloud computing system 110 ofone or more of FIGS. 1-2 ). The computer system 500 may have more orless components than those shown in FIG. 5 (e.g., one or more serverdevices of cloud computing system 110 may have fewer components thanshown in computer system 500). In one embodiment, the computer systemmay include instructions to enable execution of the processes andcorresponding components shown and described in connection with FIGS.1-4 and 6-16C.

In alternative embodiments, the machine may be connected (e.g.,networked) to other machines in a LAN, an intranet, an extranet, or theInternet. The machine may operate in the capacity of a server machine ina client-server network environment. The machine may be a personalcomputer (PC), a set-top box (STB), a server, a network router, switchor bridge, or any machine capable of executing a set of instructions(sequential or otherwise) that specify actions to be taken by thatmachine. Further, while a single machine is illustrated, the term“machine” shall also be taken to include any collection of machines thatindividually or jointly execute a set (or multiple sets) of instructionsto perform any one or more of the methodologies discussed herein

In some embodiments, the example computer system 500 (e.g., cloudcomputing system 110) includes a processing device (processor) 502, amain memory 504 (e.g., read-only memory (ROM), flash memory, dynamicrandom access memory (DRAM) such as synchronous DRAM (SDRAM)), a staticmemory 506 (e.g., flash memory, static random access memory (SRAM)), anda data storage device 518, which communicate with each other via a bus530. In some embodiments, memory (e.g., main memory 504, data storagedevice 518, etc.) may be spread across one or more mediums (e.g., of anon-demand cloud computing platform).

Processing device 502 represents one or more general-purpose processingdevices such as a microprocessor, central processing unit, or the like.More particularly, the processing device 502 may be a complexinstruction set computing (CISC) microprocessor, reduced instruction setcomputing (RISC) microprocessor, very long instruction word (VLIW)microprocessor, or a processor implementing other instruction sets orprocessors implementing a combination of instruction sets. Theprocessing device 502 may also be one or more special-purpose processingdevices such as an application specific integrated circuit (ASIC), afield programmable gate array (FPGA), a digital signal processor (DSP),network processor, or the like. In various implementations of thepresent disclosure, the processing device 502 is configured to executeinstructions for performing the operations and processes describedherein (e.g., the automated control module 224 of FIG. 2 , methods300A-D of FIGS. 3A-D, methods 1600A-C of FIGS. 16A-C, etc.).

The computer system 500 may further include a network interface device508. The computer system 500 also may include a video display unit 510(e.g., a liquid crystal display (LCD) or a cathode ray tube (CRT)), analphanumeric input device 512 (e.g., a keyboard), a cursor controldevice 514 (e.g., a mouse), and a signal generation device 516 (e.g., aspeaker).

The data storage device 518 may include a computer-readable storagemedium 528 (or machine-readable medium) on which is stored one or moresets of instructions embodying any one or more of the methodologies orfunctions described herein (e.g., automated control module 224, methods300A-D, methods 1600A-C, etc.). The instructions may also reside,completely or at least partially, within the main memory 504 and/orwithin processing logic 526 of the processing device 502 duringexecution thereof by the computer system 500, the main memory 504 andthe processing device 502 also constituting computer-readable media.

The instructions may further be transmitted or received over a network520 via the network interface device 508. While the computer-readablestorage medium 528 is shown in an example embodiment to be a singlemedium, the term “computer-readable storage medium” should be taken toinclude a single medium or multiple media (e.g., a centralized ordistributed database, and/or associated caches and servers) that storethe one or more sets of instructions. The term “computer-readablestorage medium” shall also be taken to include any medium that iscapable of storing, encoding or carrying a set of instructions forexecution by the machine and that cause the machine to perform any oneor more of the methodologies of the present disclosure. The term“computer-readable storage medium” shall accordingly be taken toinclude, but not be limited to, solid-state memories, optical media, andmagnetic media.

FIG. 6 illustrates a reflection map 600 (e.g., specular reflection map,reflection image map, specular reflection image map, etc.) for automatedcontrol of an electrochromic device, according to certain embodiments.Specular reflections may be caused by shiny or glossy surfaces, such asglass, metal, water, or the like. A reflection map 600 may be an imagemap that is generated and used for characterizing specular reflection.

A reflection map 600 may be drawn as rectangular grids of solar angles(e.g., equirectangular format). Light (e.g., sunlight) may reflect offof a surface onto an electrochromic device from any sun position,including sun positions of the sun being behind the electrochromicdevice. A reflection map 600 may encompass 360-degrees in azimuth (e.g.,azimuthal angle may be measured in a horizontal plane, azimuthal anglemay be measured in a plane perpendicular to the plane of theelectrochromic device whose intersection with the electrochromic deviceis horizontal) and 90-degrees in altitude. A reflection map 600 may besituated such that the left and right edges are north, the first quarterline is east, the center is south, and the last quarter line is west.The bottom of the reflection map 600 may be the horizon and the top ofthe image may be the zenith (e.g., point in the sky directly above theobserver). In some embodiments, regardless of the orientation or tilt ofthe electrochromic device, these orientations (e.g., north, east, south,west, horizon, zenith, or the like) may remain constant in thereflection map 600. In FIG. 6 , the reflection map 600 has positionsrelative to the site (e.g., electrochromic device, viewpoint, or thelike) marked.

The reflection map 600 may be an unwrapped cylinder of 360-degree imageof all possible sun positions in the sky relative to the electrochromicdevice (e.g., behind, to the front of, to the sides of, etc. theelectrochromic device).

In some embodiments, the reflection map 600 may be 720 pixels wide by180 pixels tall and may have a resolution of 0.5-degrees per pixel.Pixels may represent a half degree of angular range. The first column ofpixels may represent azimuth angles from 0-degrees to 0.5-degrees. Thecenter of the first column of pixels may be 0.25-degrees azimuth. Thismay continue until the last column, which covers 395.5-degrees to360-degrees, centered at 359.75-degrees. The same may apply to thevertical pixel representation.

Each pixel of the reflection map 600 may have one or more correspondingpixel values (e.g., stored in one or more channels). In someembodiments, a pixel value of zero (e.g., a value of zero stored in thealpha channel for the pixel) may indicate there is not a risk ofreflected glare when the sun is in the position represented by thepixel. A pixel value greater than zero (e.g., a value greater than zerostored in the alpha channel for the pixel) may indicate that there is arisk of glare when the sun is in the position represented by the pixel.

In some embodiments, the position of the reflection in the field of view(e.g., elevation, altitude, etc.), the incidence angle of the reflectionon the electrochromic device, and the properties of the surface causingthe reflection may not be calculated solely from the position of thesun. In some embodiments, the position factor, angular transmissionfactor, and/or specular reflection property may be calculated (e.g.,when the reflection map 600 is generated) and may be encoded as a singlecoefficient (e.g., pixel value) to be stored for the pixel and to beused to calculate the adjusted direct normal irradiance (DNI) fordetermining a tint level for the electrochromic device.

The position factor for a reflection may be determined based on theposition of the reflection relative to the electrochromic device (e.g.,elevation, altitude, etc.). The angular transmission factor for areflection may be determined based on the incidence angle of thereflection relative to the electrochromic device. The specularreflection property for a reflection may be determined based on aproperty of the surface that caused the reflection.

In some embodiments, the position factor, angular transmission factor,and/or specular reflection property may be calculated and stored asseparate pixels values for the pixel (e.g., the position factor may bestored in a first channel, the angular transmission factor may be storedin a second channel, and the specular reflection property may be storedin a third channel).

In some embodiments, a reflection map 600 may be in a 32-bit, fourchannel (8-bit per channel) portable network graphic (PNG) format. Insome embodiments, the first three channels (e.g., red, green, blue(RGB)) may all contain the same coefficient which is the product ofsurface specular reflectance, position factor, and angular transmissioncoefficient multiplied by 256. The fourth channel (e.g., alpha) mayindicate whether or not a reflection occurs. The fourth channel may havea value of zero when no reflection occurs for the sun position and mayhave a value of 255 when a reflection does occur.

A sun position may cause more than one reflection to an electrochromicdevice (e.g., sunlight reflects off of a body of water and off of abuilding to the electrochromic device). In cases of multiplereflections, the reflection with the larger pixel value (e.g., greaterilluminance) may be retained. The higher pixel values may result indarker tint levels.

FIG. 7 illustrates a 3D model 700 of a site for generating a reflectionmap, according to certain embodiments. FIG. 8 illustrates a rendering800 of the 3D model 700 of the site from the view of an electrochromicdevice 712, according to certain embodiments. The 3D model 700 may be anexample model for illustrating the reflection map 600. The 3D model mayinclude a building 710 that includes an electrochromic device 712. The3D model may also include a body of water 720 (e.g., a small pond ofwater) and a glass building 730. In this example the reflectance of theglass building 730 may be 15% and the reflectance of the body of water720 may be 6%.

In the 3D model 700, sample rays may be cast from the electrochromicdevice 712 sampling the hemisphere in 0.5-degree increments. In someembodiments, the sample rays are cast from a common location on theelectrochromic device. In some embodiments, the sample rays are castfrom multiple locations on the electrochromic device. The amount oflocations may vary depending on the size of the electrochromic device(e.g., cast from more locations for a larger electrochromic device).Sample rays may be cast from one or more locations that are in the fieldof view of users (e.g., not below workspace depth level). In the 3Dmodel, the sample rays cast from the electrochromic device 712 maycontact a surface (e.g., glass façade, body of water, or the like) andbe reflected in the 3D model to a corresponding sun position.

In the 3D model 700, sample rays may be generated in a UVW vector spacedefined by orientation of the electrochromic device 712 (e.g., in theLawrence Berkley National Laboratory (LBNL) window bi-directionalscattering distribution function (BSDF) convention) (e.g., V=normal,W=up, and U=in a plane perpendicular to up). The sample rays may betranslated between real world and CAD model space using a transformationmatrix. The real world coordinates may use XYZ radiance convention ofY=north, X=east, and Z=up.

The position factor and the angular transmission coefficient may begenerated based on the sample ray directions. The V component of thesample unit vector may be used to calculate the incidence angle of thereflection on the electrochromic device as follows:refl_inc_ang=a cos(v)

The Z-component of the real world unit vector for the sample ray may beused to calculate altitude angle of the reflection as follows:refl_alt_ang=a sin(Z)

The position index may be calculated using Guth's position index (e.g.,assuming t=0, the observer is looking toward the reflection) forreflection altitude angles above horizontal, and using Einhorn'sanalytical equation for reflection altitude angles below horizontal asfollows:

if refl_alt_ang>=0:position_index=e{circumflex over( )}(0.03398*refl_alt_ang+0.00021*refl_alt_ang{circumflex over ( )}2)

else: #refl_alt_ang<0

-   -   if tan(−refl_alt_ang)>=0.6:        position_index=1+1.2*tan(−refl_alt_ang)    -   else:        position_index=1+0.8*tan(−refl_alt_ang)

When calculating the position factor, a position factor weight (e.g., 1)may be used, which allows a different weight to be applied at runtime.The position factor may be calculated as follows:position_factor=1/position_index

If a propagation distance is set, the propagation distance and windowheader height (e.g., height of the header of the electrochromic device)may be used to cut off sample rays that would be shaded by the windowheader. The sample rays may be traced into the 3D model 700 by sendingthe sample rays to the standard input of the following Radiance rtracecommand:

rtrace-ab 0-st 0-1r 1-h-otwdv model.oct

The following table may explain the parameters used in the rtracecommand above:

Parameter Name Description -ab 0 Ambient bounces Turns off diffusereflections -st 0 Specular threshold A threshold of zero allow specularreflections (e.g., ensure all specular reflections) are traced -lr 1Limit reflections Limits specular reflections to a single bounce (e.g.,the reflection map may not control for secondary or higher orderreflections) -h Header Turns off the header in the output -otwdv Outputspecification Outputs the following: t—whole ray tree w—ray weight d—raydirection v—ray value

The primary rays in the ray tree may be the sample rays and may bemostly ignored (e.g., except to keep track which sample is currentlybeing considered). The secondary rays in the ray tree may be thespecular reflections. The weight of the secondary rays may be equal tothe specular reflectance of the surface. The direction of a secondaryray may be the direction of the reflected ray towards the sky, which maybe used to know the position of the sun that causes the reflection.

The secondary rays in the tree may be used. Secondary rays with a valuegreater than zero may find their way to the sky. For the secondary rayswith a value of greater than zero, the direction vector of the secondaryray may be converted into azimuth/altitude angle for the sun positionand a reflection map pixel index may be generated from the angles. Theweight of the secondary ray may be the reflectance of the surface (e.g.,modified by Fresnel equations to account for non-normal incidence).

FIG. 9A illustrates a reflectance map 900A generated for the 3D model700, according to certain embodiments. The white background may be aresult of the alpha channel being set to zero where there is no specularreflection.

The reflectance map 900A may be an equirectangular image. Reflectancemap 900A may be generated assuming that all surfaces are perfectlysmooth and oriented exactly according to the model. In the real world,glass façades may have deflections and wind blowing over water may causeroughness. To accommodate for these imperfections, the reflection map900A may be resampled to include a wider range of sun angles that couldcause offensive reflections. The resampling may consider all pixelswithin an angular radius and may use the maximum value of pixels withinthe angular radius.

FIG. 9B illustrates a reflection map 900B that has been resampled,according to certain embodiments. Reflection map 900B may be resampledwith 3-degrees (e.g., 6-pixel) radius.

FIG. 10A illustrates a plan view 1000 of the 3D model 700, according tocertain embodiments. The plan view 1000 may illustrate the sample andreflection rays 1010A-C.

By verifying the reflection angles in plan view may demonstrate thatreflections occur approximately where expected. The plan view 1000illustrates arrows representing rays 1010A-C for each surface type.

FIG. 10B illustrates a reflection map 1020 with boxes 1030A-C around sunpositions, according to certain embodiments. Box 1030A corresponds toreflection rays 1010A, box 1030B corresponds to reflection rays 1010B,and box 1030C corresponds to reflection rays 1010C. Box 1030A maycorrespond to a larger surface of a glass building 730, box 1030B maycorrespond to the body of water 720, and box 1030C may correspond to asmaller surface of glass building 730 that is perpendicular to thelarger surface of building 720.

FIG. 10C illustrates the reflection map 1020 with coordinates 1040 ofspot checks, according to certain embodiments. The sun positions may bespot checked in the reflection map 1020 by rendering an image with thesun in the selected position (e.g., coordinates). Positions (e.g.,coordinates) identified may be in corners or along edges of thereflection map 1020 to verify reflections occurred for those positionsand may be near the edge or in the corner of the reflecting surface. Thecoordinates may indicate sun position (e.g., azimuth, altitude). Forexample, set of coordinates 1040A may be (82.25, 27.25), set ofcoordinates 1040B may be (113.25, 22.25), set of coordinates 1040C maybe (111.75, 7.25), set of coordinates 1040D may be (176.25, 18.75), setof coordinates 1040E may be (211.25, 9.25), set of coordinates 1040F maybe (216.75, 15.25), and set of coordinates 1040G may be (260.75, 20.25).In some embodiments, the spot checks may be performed to check theaccuracy of the reflection map. In some embodiments, the spot checks maybe performed to check the accuracy of the automated control module 224(e.g., the accuracy of the generating, by the automated control module224, of reflection maps). In some embodiments, the spot checks may beperformed to check the accuracy of the 3D model (e.g., surfaceproperties in the 3D model, objects entered in the 3D model, objectsomitted from the 3D model, or the like).

A spot check may be performed for the sun position when anelectrochromic device is not accurately being tinted based on thereflection map (e.g., by the automated control module 224). The spotcheck may indicate a set of coordinates of a sun position. A renderedmodel (e.g., see FIGS. 11A-G) may be generated to show the location ofthe reflection corresponding to the sun position coordinates from thespot check. The actual location may be examined to determine why theelectrochromic device is not being accurately tinted.

In some embodiments, an electrochromic device may be tinted based on thereflection map without having any actual reflections. For example, anobject (e.g., tree, pier on a body of water, new structure) that is notaccounted for in the 3D model may be obstructing the location of thereflection. In some embodiments, an electrochromic device may not betinting enough based on the reflection map to account for actualreflections. For example, an object in the 3D may have an actualreflection greater than what was modeled. In another example, an object(e.g., automobiles in a new parking lot) or property of an object (e.g.,surface property, angle, or the like) may not be accounted for in the 3Dmodel. The spot check may indicate a set of coordinates of a sunposition and the rendered model may be generated to show the location ofthe reflection corresponding to the sun position. The actual locationmay be examined to determine why the reflection map did not account forthe actual reflection.

Based on the spot check and/or rendered model, the 3D model and/or theautomated control module 224 may be updated to more accurately representthe actual conditions and to generate a more accurate reflection map.

FIGS. 11A-G illustrate rendered models 1100A-G for sets of coordinates1040A-G, according to certain embodiments. The rendered models 1100 maybe used to verify the accuracy of one or more of the reflection map, the3D model (e.g., objects in the 3D model, surface properties of the 3Dmodel), or the automated control module 224. For example, if anelectrochromic device is not accurately tinting (e.g., too high or toolow of a tint state) for a sun position, a rendered model may begenerated to compare the rendered reflection or lack of reflection inthe rendered model with the actual reflection or lack of reflectioncoming into the electrochromic device from the actual environment. Bycomparing the rendered model with the actual environment, updates to oneor more of the reflection map, 3D model, or automated control model 224may be made to generate a more accurate reflection map.

Rendered model 1100A may illustrate the set of coordinates 1040A ofsolar azimuth of 82.25-degrees and solar altitude of 27.25-degrees.

Rendered model 1100B may illustrate the set of coordinates 1040B ofsolar azimuth of 113.25-degrees and solar altitude of 22.25-degrees.

Rendered model 1100C may illustrate the set of coordinates 1040C ofsolar azimuth of 111.75-degrees and solar altitude of 7.25-degrees. Inrendered model 110C, there are two reflections that occur for the givensun position (e.g., a first reflection from the body of water and asecond reflection from the glass building). The reflection map may storethe larger of the coefficients for the two reflections. The coefficientmay equal the product of reflectance, position factor, and angulartransmission coefficient (e.g., reflectance*position factor*angulartransmission coefficient).

Rendered model 1100D may illustrate the set of coordinates 1040D ofsolar azimuth of 176.25-degrees and solar altitude of 18.75-degrees.

Rendered model 1100E may illustrate the set of coordinates 1040E ofsolar azimuth of 211.25-degrees and solar altitude of 9.25-degrees.

Rendered model 1100F may illustrate the set of coordinates 1040F ofsolar azimuth of 216.75-degrees and solar altitude of 15.25-degrees. Inthe rendered model 1100F, the sun position may not be at the corner ofthe reflecting surface, however reflections to the right of this pointin the body of water may be blocked by the glass building.

Rendered model 1100G may illustrate the set of coordinates 1040G ofsolar azimuth of 260.75-degrees and solar altitude of 20.25-degrees.

In some embodiments, there may be a unique reflection maps (e.g.,specular reflection maps) for each electrochromic device (e.g., from theunique viewpoint of the electrochromic device). In some embodiments,there may be a single reflection map for a group of electrochromicdevices that are in close proximity to each other (e.g., a row ofelectrochromic devices, a column of electrochromic devices, a collectionof electrochromic devices, a set of electrochromic devices that areconfigured to be controlled together, or the like).

The reflection map may be sampled by converting site solar azimuth andsite solar altitude to image pixel coordinates. First, the alpha channelis checked to see if a reflection occurs for that sun position. Then,one of the RGB channels may be queried to obtain the coefficient for thesun position. The channel value may be divided by 256 to obtain thecoefficient. The reflection coefficient may be multiplied by thefiltered DNI to determine the transmitted adjusted DNI for thereflection. The transmitted adjusted DNI may then be entered into thetint curve for the electrochromic device to determine a minimum tintsetting for the electrochromic device.

In some embodiments, two values are encoded (e.g., stored) into the fourchannels of a PNG image, with the coefficient being repeated across theRGB channels. In some embodiments, the surface reflectance, positionfactor, and normalized angular transmission are encoded into eachchannel separately. The reflectance (e.g., property of the surfacecausing the reflection), position factor (e.g., position of thereflection on the electrochromic device), and normalized angularincidence transmission (e.g., incidence angle for the reflection on theelectrochromic device) may be stored in the reflection map's RGBchannels of the pixel and the alpha channel may be changed from 0 to255.

FIGS. 12A-D illustrate reflection maps 1020, according to certainembodiments. Reflection map 1020A may illustrate a combined reflectionmap (e.g., channels 1-4). Reflection map 1020B may correspond to a firstchannel, reflection map 1020C may correspond to a second channel, andreflection map 1020D may correspond to a third channel.

Channel Value 1 (red) Surface reflectance (e.g., parabolic mapping:reflectance = (pixel/256){circumflex over ( )}2), property of thesurface) 2 (green) Reflection elevation angle (linear mapping where−90-degrees = 0; and +90-degrees = 255; position) 3 (blue) Reflectionincident angle (linear mapping where: 0-degrees = 0; and 90-degrees =255; incidence angle) 4 (alpha) Boolean value where: 255 for sunpositions with reflections to the electrochromic device; and 0 for sunpositions with no reflections to the electrochromic device.

FIG. 13 illustrates a graph 1300 of surface reflectance to pixel value,according to certain embodiments. The graph illustrates a first line1310 that is linear, a second line 1320 that is piecewise linear, and athird line 1330 that is parabolic (e.g., (x/256){circumflex over ( )}2).

In some embodiments, automated control of electrochromic devices may bebased on one or more of an obstruction map, a reflection map,illuminance value (e.g., vertical illuminance calculation, bright skycalculation, bright sky glare), or the like.

FIG. 14 illustrates use of a daylight coefficient (DC), according tocertain embodiments. A daylight coefficient may relate illuminance at alocation in a room (e.g., on a desk, at a point of view, or the like) toluminance of environmental patches (e.g., sky patches, diffuse surfacepatches, etc.). A daylight coefficient may include inter-reflection inthe room (e.g., reflecting off of walls, ceiling, floor, objects, or thelike) and/or outside the electrochromic device. An automated controlmodule 224 of a cloud computing system 110 may use sensor data (e.g.,from an exterior sensor 216, from an interior sensor 206) and one ormore daylight coefficients to determine an illuminance value at alocation in the room. The automated control module 224 may control thetinting state of one or more electrochromic devices (e.g., via gateway106 and driver 104) based on the illuminance value.

An illuminance value may indicate vertical illuminance at the eye (e.g.,vertical eye illuminance) for occupants near the façade (near theelectrochromic device). The vertical eye illuminance may be convertedinto a simplified daylight glare probability (DGP). DPG may be as shownin the table below:

Daylight Glare Subjective Vertical Illuminance Probability (DGP) Ratingat Eye (for DGPs) <0.35 Imperceptible <2650 0.35-0.4  Perceptible2650-3475  0.4-0.45 Disturbing 3475-4275 >0.45 Intolerable >4275 DPGs =6.22 * (10{circumflex over ( )}−5) * E_(v) + 0.184

The vertical eye illuminance may be calculated using a daylightcoefficient method. Daylight coefficients related the luminance ofdiscrete sky patches to illuminance contributions at the sensor point.The coefficients may be multiplied by sky luminance values for each ofthe patches to determine illuminance at a point of view (e.g.,viewpoint, sensor point). For zones where automation will controlelectrochromic devices in more than one group, separate daylightcoefficients may be generated for each collection of electrochromicdevices, allowing illuminance contribution for each collection ofelectrochromic devices to be known for all tint levels.

The sky patch luminance values may be generated using Perez all weathersky model generated with diffuse horizontal and direct normalirradiance. The sky patch luminance values may be stored in a vectorreferred to as a sky vector. Radiance's validated and robust workflowmay be used for sky vectors.

Light from many adjacent electrochromic devices may combine to causevertical eye illuminance (e.g., bright sky glare). Illuminance or glaremay be a function of brightness and size in the field of view. For aparticular sky brightness, a single electrochromic device by itself maynot be large enough to induce glare, however two or more electrochromicdevices next to each other might cause glare under the same conditions.A representative amount of electrochromic devices in a room may beconsidered. For a smaller room (e.g., a small private office), therepresentative amount of electrochromic devices may be all of theelectrochromic devices of the smaller room. For a larger room (e.g., alarge open office with a curtain wall façade), the representative amountof electrochromic devices may be five electrochromic devices wide (e.g.,a row of five electrochromic devices).

Electrochromic devices that are controlled as a group by automation maybe combined into collections of electrochromic devices for verticalilluminance calculation (e.g., bright sky glare calculation). In a roomwith floor to ceiling electrochromic devices without horizontal breaks,there may be a single collection of electrochromic devices containingall of the electrochromic devices. In a room with stacked rows ofelectrochromic devices (e.g., three stacked rows), each row may be aseparate collection of electrochromic devices.

Automation (e.g., cloud computing system 110, automated control module224, etc.) may control the electrochromic devices using discrete tintlevels (e.g., nine discrete tint levels). For a room with nine tintlevels, there are 9{circumflex over ( )}n possible tint combinationsbased on tint combinations where “n” is the number of collections ofelectrochromic devices. Since all electrochromic devices are to beconsidered together for vertical illuminance (e.g., bright sky glare),the vertical illuminance may be evaluated for each potential tintcombination. The number of tint combinations can first be reduced bydirect sun or specular reflected glare constraints, if any exist. Forexample, if a room has three collections of electrochromic devices, buttwo of the collections are to be set to tint level 80 to satisfy directsun glare, then there are only three possible tint levels for two of thecollections of electrochromic devices (e.g., 80, 90, and 100). The totalnumber of potential tint combinations for vertical eye illuminance(e.g., bright sky glare) are then 81 (e.g., (3{circumflex over( )}2)*(9{circumflex over ( )}1)=81).

In some embodiments, a model (e.g., radiance model) may be generated(e.g., block 1632 of method 1600B) based on dimensions of a room fordetermining an illuminance value at a location in the room (e.g., block1638 of method 1600B). Daylight coefficients may be generated forvertical eye illuminance. The model may be a simplified model of theroom and façade. Generation of the model may be performed with a simplescript (e.g., python script) with basic geometric information. Forexample, a python script may generate a model based on room dimensions,electrochromic device sizes, and positions and viewpoints of anddirections. Along with generating the model (e.g., geometric model), thescript may run simulations to generate daylight coefficients forvertical eye illuminance.

In the model, the electrochromic devices may be assigned to threecollections corresponding to the top row, middle row, and bottom row.Daylight coefficients may be created for each collection ofelectrochromic devices. The result of the daylight coefficientsimulation may be a file for each collection of electrochromic devicescontaining a row for each viewpoint and 578 columns (e.g., one for eachsky patch). The daylight coefficient matrices may be loaded into apython numpy array ready to be multiplied by a sky vector.

A sky vector may contain average luminance values within discretizedpatches of sky hemisphere. Although the terms sky vector, sky patches,bright sky glare, or the like are used herein, references to sky mayalso refer to other portions of the environment relative to theelectrochromic device. For example, a building (e.g., light-colorbuilding, building with a diffuse surface) or other objects (e.g., thatprovide diffuse reflection) may be part of the sky vector, sky patches,bright sky glare, or the like.

Sky vectors (e.g., see FIGS. 14-15 ) may be used for calculatingvertical eye illuminance. A high dynamic range (HDR) image of the sky(environment) may be captured (e.g., from the roof, from a viewpoint ofthe electrochromic device, etc.). The image may illustrate a hemisphereof the environment (e.g., sky, sun, clouds, buildings, or the like) froma viewpoint proximate the electrochromic device (e.g., from an externalsensor or camera on the same or a proximate building as theelectrochromic device). An image of the environment (e.g., sky) may bebroken into 145 patches (e.g., using the Tregenza discretizationscheme). The patches may be indexed from 1 (e.g., north horizon) to 145(e.g., zenith) in a spiral pattern, with zero patch being the ground

One or more types of sky vectors may be used for calculating verticaleye illuminance. A sky luminance gradient may be divided into a firstdiscretized sky luminance (e.g., Tregenza) that has a lower resolutionor a second discretized sky luminance (e.g., Reinhart MF:4, first fordirect sun consideration) that has a higher resolution. In someembodiments, the amount of sky patches may be 145, 577, 2305, or someother value.

In some embodiments, the sky vector may be generated using a sky modelsuch as the Perez All-weather sky model, which is sampled one or morepositions within a sky patch. In some embodiments, the sky vector may begenerated using one or more of the following radiance programs:

gendaylit—generate Perez all-weather sky from DNI, DHI, façade, solareazimuth, and solar altitude;

genskyvec—convert the sky model into a sky vector;

rmtxop—convert the RGB radiance channels into a single luminancechannel; or

getinfo—remove the header data.

The sky vectors may be generated (e.g., by a sky vector generator) asfollows:

def gen_skyvector(facade_solar_azimuth, solar_altitude, DNI, DHI,sun=True, unit=‘visible’):

-   -   if unit==‘visible’:    -   genday_spectrum=“0”    -   efficacy=“179”    -   elif unit ‘solar’:    -   genday_spectrum=“1”    -   efficacy=“1”    -   else:    -   print(‘skyvector-unit must be \‘visible†’ or \‘solar\’’)    -   if sun:    -   sun_switch=“+s”    -   else:    -   sun_switch=“−s”    -   gendaylit=subprocess.Popen([str(elem) for elem in [“gendaylit”,        “−ang”, solar_altitude, facade_solar_azimuth,    -   “−O”, genday_spectrum, sun_switch, “−W”, DNI, DHI]],        stdout=subprocess.PIPE)    -   genskyvec=subprocess.Popen([“genskyvec”, “−m”, “2”, “−c”, “1”,        “1”, “1” ],    -   stdin=gendaylit.stdout, stdout=subprocess.PIPE)    -   rmtxop=subprocess.Popen([“rmtxop”, “−c”, “0”, efficacy, “0”,        “−”], stdin=genskyvec.stdout, stdout=subprocess.PIPE)    -   getinfo=subprocess.Popen([“getinfo”, “−” ], stdin=rmtxop.stdout,        stdout=subprocess.PIPE)    -   gendaylit.stdout.close( )    -   genskyvec.stdout.close( )    -   rmtxop.stdout.close( )    -   skyvec=[float(a) for a in getinfo.communicate(        )[0].decode(“utf-8”).strip( ).split(‘\n’)]    -   return(skyvec)

The output may of the sky vector generator may be a series of 578luminance values (e.g., one ground patch followed by 577 sky patches).

To calculate an illuminance value (e.g., vertical eye illuminance,bright sky glare), daylight coefficients may be multiplied by the skyvector to calculate the vertical eye illuminance contribution for eachcollection of electrochromic devices in the clear state.

A first function to load the daylight coefficient matrices into a nestedlist may be as follows:

def loadDC(filename):

-   -   mainlist=[ ]    -   with open(filename, ‘r’) as infile:        -   dc_file=csv.reader(infile, delimiter=‘\t’)    -   for row in dc_file:        -   mainlist.append([float(item.strip( )) for item in row if            item !=″])    -   return(mainlist)

window_collections=[‘ST’, ‘SM’, ‘SB’]

daylight_coefficient_matricies=[loadDC(‘DC/’+win+‘_vp.dcx’) for win inwindow_collections]

The sky vector may be calculated as follows:

skyvector=gen_skyvector(facade_solar_azimuth=0, solar_altitude=72,DNI=200, DHI=350, sun=True, unit=‘visible’)

The daylight coefficients may be multiplied by the sky vector togenerate partial illuminance contributions for each collection ofelectrochromic devices as follows:

viewpoints_ill=[numpy.matmul(dc, skyvector) for dc indaylight_coefficient_matricies]

viewpoints_ill:

-   -   [[4104.9, 4368.2, 1539.5, 1721.8, 1605.3, 1735.6],        -   [14588.8, 4098.0, 5407.4, 1629.5, 5401.8, 1640.5],        -   [1445.5, 2465.5, 1403.9, 1137.9, 1473.9, 1161.9]]

The partial illuminance contributions may be normalized to aperpendicular incidence visible light transmission (VLT) of 100%, sothat other VLT settings can be tested by multiplying by theperpendicular incidence of the glazing (e.g., to get viewportilluminance of a first electrochromic device with tint level of zero,multiply by 65% or for a second electrochromic device, multiple by 52%).To calculate vertical illuminance for tint levels of a combination ofcollections of electrochromic devices, matrix multiplication may be usedto multiply the VLT level for each collection of electrochromic devicesby the partial illuminance contribution matrix as follows:

#Illuminance for all window collections clear:

all_clear=numpy.matmul([0.52, 0.52, 0.52], viewpoints_ill)

-   -   [10472.4, 5684.5, 4342.4, 2334.4, 4410.1, 2359.8]

#Illuminance for Middle row tinted:

middle tinted=numpy.matmul([0.52, 0.001, 0.52], viewpoints_ill)

-   -   [2900.8, 3557.6, 1536.0, 1488.7, 1606.6, 1508.4]

To calculate DGPs for each viewpoint, a linear function may be appliedto the vertical illuminance values:

DGPs=lambda x: round(0.0000622*x+0.184, 3)

#DGP for all windows clear:

list(map(DGPs, all_clear))

[0.835, 0.538, 0.454, 0.329, 0.458, 0.331]

#DGP for middle row tinted:

list(map(DGPs, middle tinted))

[0.364, 0.405, 0.28, 0.277, 0.284, 0.278]

To create a list of all tint combinations with DGPs below 0.35, a listof all possible tint combinations may be created. The list of allpossible tint combinations may be constrained by direct sun glare andspecular reflection glare. Then, each option (e.g., possible tintcombination) may be multiplied by the partial illuminance matrix. SinceDGPs is a linear function, the maximum vertical illuminance may be usedto calculate the DGP. If that DGP is less than 0.35, the tintcombination meets the illuminance constraint (e.g., vertical illuminancerestraint, bright sky glare constraint) as follows:

tint_options=[ ]

for WC1 in [0.52, 0.25, 0.11, 0.05, 0.02, 0.01, 0.004, 0.002, 0.001]:

-   -   for WC2 in [0.52, 0.25, 0.11, 0.05, 0.02, 0.01, 0.004, 0.002,        0.001]:        -   for WC3 in [0.52, 0.25, 0.11, 0.05, 0.02, 0.01, 0.004,            0.002, 0.001]:            -   tint_options.append([WC1, WC2, WC3])

valid_options=[option for option in tint options ifDGPs(max(numpy.matmul(option, viewpoints_ill)))<0.35]

In this case, there may be 534 valid options from the 729 potentialcombinations as follows:

len(valid_options)

534

The following table contains all the tint combinations for the middleand top rows, with the bottom row at 52% VLT. The cells containing‘TRUE’ represent a tint combination that meets the restriction ofDGPs<0.35, while the cells containing ‘FALSE’ represent a tintcombination that violates the illuminance combination (e.g., bright skyglare combination):

SB = 0.52 SM (Middle Row) Tint Levels (Bottom Row) 0.52 0.25 0.11 0.050.02 0.01 0.004 0.002 0.001 ST 0.52 FALSE FALSE FALSE FALSE FALSE FALSEFALSE FALSE FALSE (Top 0.25 FALSE FALSE FALSE TRUE TRUE TRUE TRUE TRUETRUE Row) Tint 0.11 FALSE FALSE FALSE TRUE TRUE TRUE TRUE TRUE TRUELevels 0.05 FALSE FALSE TRUE TRUE TRUE TRUE TRUE TRUE TRUE 0.02 FALSEFALSE TRUE TRUE TRUE TRUE TRUE TRUE TRUE 0.01 FALSE FALSE TRUE TRUE TRUETRUE TRUE TRUE TRUE 0.004 FALSE FALSE TRUE TRUE TRUE TRUE TRUE TRUE TRUE0.002 FALSE FALSE TRUE TRUE TRUE TRUE TRUE TRUE TRUE 0.001 FALSE FALSETRUE TRUE TRUE TRUE TRUE TRUE TRUE

FIG. 15 illustrates a three-phase method to break flux transfer intothree phases, according to certain embodiments. The three phases mayinclude exterior (D), window transmission (T), and interior V).

In some embodiments, an obstruction map including information regardingexterior obstructions may be available. To determine whether theenvironment (e.g., sky, cloud, diffuse surfaces on buildings,light-color buildings, etc.) causes glare, the obstruction map may beused to determine if part of the environment is obstructed byneighboring buildings, building-attached shading (e.g., overhangs,etc.). The obstruction map may be used to mask part of the sky in thevertical illuminance calculation (e.g., bright sky glare calculation) byusing a three-phase method to generate daylight coefficients. Thethree-phase method may break flux transfer between the environment andviewpoint in the room (e.g., illuminance point) into three phases: theexterior phase (D); the window transmission phase (T); and the interiorphase (V) (e.g., reflections off of interior surfaces). The obstructionmap may be resampled into a bi-directional scattering distributionfunction (BSDF) and incorporated into the window transmission matrix. Adaylight coefficient matrix may be generated by multiplying the threephase matrices (e.g., V, T, and D in FIG. 15 ).

In some embodiments one or more of the obstruction map, reflection map,and illuminance value may be combined to provide automated control ofelectrochromic devices.

FIGS. 16A-C are flow diagrams of methods 1600A-C for providing automatedcontrol of an electrochromic device, according to certain embodiments.The methods 1600A-C can be performed by processing logic that caninclude hardware (e.g., processing device, circuitry, dedicated logic,programmable logic, microcode, hardware of a device, integrated circuit,etc.), software (e.g., instructions run or executed on a processingdevice), or a combination thereof. In some embodiments, the methods1600A-C are performed by the cloud computing system 110 of FIG. 1 orFIG. 2 (e.g., automated control module 224 of cloud computing system110). In some embodiments, the methods 1600A-C are performed by one ormore server devices of the cloud computing system 110. In someembodiments, the methods 1600A-C are performed by a processing device ofthe cloud computing system 110 (e.g., a non-transitory machine-readablestorage medium storing instructions which, when executed cause aprocessing device to perform methods 1600A-C). In some embodiments, themethods 1600A-C are performed by an automated control module 224 of thecloud computing system 110. In some embodiments, one or more portions ofmethods 1600A-C are performed by one or more other components (e.g.,gateway, etc.). For example, the server device may transmit one or moreof an obstruction map, projection information, sun map, or sensor datato the gateway and the gateway may use the one or more of obstructionmap, projection information, sun map, or sensor data to control anelectrochromic device.

Although shown in a particular sequence or order, unless otherwisespecified, the order of the processes can be modified. Thus, theillustrated embodiments should be understood only as examples, and theillustrated processes can be performed in a different order, and someprocesses can be performed in parallel. Additionally, one or moreprocesses can be omitted in various embodiments. Thus, not all processesare required in every embodiment. Other process flows are possible.

FIG. 16A is a flow diagram of a method 1600A for providing control of anelectrochromic device using a reflection map, according to certainembodiments.

At block 1602, the processing logic receives a 3D model of environmentrelative to an electrochromic device. The 3D model may include objects(e.g., body of water, glass building, windshields of automobiles, or thelike) and the electrochromic device. The 3D model may indicate the typeof surfaces of the objects and the surface properties of each of thesurfaces. For example, a surface of a glass building may have a firstsurface property and a surface of a body of water may have a secondsurface property. In addition to reflecting objects, the 3D model mayinclude non-reflecting objects (e.g., non-reflecting building, etc.) orfeatures (e.g., overhang, etc.) that may obstruct the electrochromicdevice.

In some embodiments, in the 3D model, the surface property of the bodyof water may indicate the type of surface that would generate the mostreflection (e.g., still water surface due to no wind, agitated water dueto wind, etc.). In some embodiments, in the 3D model, multiple surfaceproperties are assigned to the body of water. A reflection for eachsurface property may be determined and the greatest reflection is usedin the reflection map.

In some embodiments, location, quantity, type, and/or angle one or moreobjects relative to the electrochromic device may change over time. Forexample, the location, quantity, type, and/or angle of cars in a parkinglot may change over time. In another example, the type and/or angle ofmoveable portions of a building may change over time (e.g., a rotatingbuilding, a retractable roof structure, or the like). In someembodiments, the 3D model may be representative of surfaces of objectsthat would cause the greatest amount of reflections (e.g., a fullparking lot with windshields angled towards the electrochromic device,moveable portions of buildings angled towards the electrochromic device,or the like). In some embodiments, the 3D model is representative ofmultiple scenarios of location, quantity, type, and/or angle of objects.The reflections may be determined for the different scenarios and thegreatest reflection may be used. In some embodiments, multiplereflection maps can be generated for different variations (e.g., foreach location, quantity, type, and/or angle) and the reflection maps maybe combined into one overall reflection map (e.g., parametric set ofwindshields). In some embodiments, the 3D model may be indicative oflocation, quantity, type, and/or angle of objects at different times ofthe year (e.g., parking lot empty on weekends and holidays, retractableroof is closed during winter months, or the like) and the location,quantity, type, and/or angle of objects corresponding to the specifictime of year may be used in generating the reflection map.

At block 1604, the processing logic determines based on the 3D model,reflections (e.g., sunlight reflections) from objects in the environmentto the electrochromic device for sun positions. Each of the reflectionsmay be from a corresponding surface of the objects to the electrochromicdevice for a corresponding sun position. In some embodiments, theprocessing logic may determine reflections for sun positions of a fullelevation (e.g., between horizon and zenith, 90-degrees in altitude) anda full angular rotation (e.g., 360-degrees in rotation including north,south, east, and west, full 360-degrees in azimuth) relative to theelectrochromic device. In some embodiments, the processing logic maydetermine reflections for actual sun positions (e.g., any location wherethe sun may be located relative to the electrochromic device, any solarposition over the course of a year). In some embodiments, the processinglogic may determine the reflections by casting, in the 3D model, raysfrom the electrochromic device to sample the environment. Each of thereflections may correspond to a respective ray reflecting off of acorresponding surface of an objection for a corresponding sun position.

In some embodiments, instead of or in addition to using a 3D model, theprocessing logic may use dimensional measurements to determinereflections. For example, the processing logic may receive firstdimensions of an electrochromic device and second dimensions of objectsrelative to the electrochromic device (e.g., geometries of theelectrochromic device and/or objects). The first dimensions of theelectrochromic device may include one or more of height, width, orthickness of the electrochromic device. The second dimensions mayinclude an overhang, height of the overhang above the electrochromicdevice, extension of the overhang of one or more obstructions of theelectrochromic device, buildings, bodies of water, or the like. In someembodiments, the processing logic receives the first and seconddimensions via user input. In some embodiments, the processing logicreceives the first and second dimensions by processing a 3D model.

In some embodiments, the same model (e.g., 3D model, measurements, etc.)are used for two of more of the obstruction map, the reflection map, orthe illuminance value.

At block 1606, the processing logic, for each reflection, determines acorresponding position, a corresponding incidence angle, and acorresponding surface property. The corresponding position may indicatean elevation of the reflection relative to the electrochromic device(e.g., location of the reflection in the field of view, such as top leftcorner, middle, or the like). The corresponding incidence angle mayindicate the angle of the reflection relative to the electrochromicdevice (e.g., 90-degree angle, 45-degree angle, etc.). The correspondingsurface property may be indicative of an amount of sunlight that wouldreflect from the surface (e.g., surface roughness, irregularity of thesurface, or the like). In some embodiments, the surface property mayinclude an indication of one or more of specularity of reflection of thesurface, surface roughness, or the like. The processing logic maydetermine the position and the incidence angle of the reflections basedon the casting of rays from the electrochromic device to theenvironment.

At block 1608, the processing logic generates a reflection map based onthe reflections. The reflection map may be indicative of, for eachreflection, the corresponding position, the corresponding incidenceangle, and the corresponding surface property.

In some embodiments, the reflection map may be an equirectangular mapthat is from horizon to zenith (e.g., 0 to 90-degrees in altitude) andin a 360-degree angular rotation (e.g., including north, east, south,and west) relative to the electrochromic device. The processing logicmay generate pixels on the reflection map. Each pixel may indicate oneor more properties of the reflection. For example, an alpha channel ofeach pixel may indicate whether or not there is a reflection at that sunposition. One or more additional channels may indicate the correspondingposition, the corresponding incidence angle, and the correspondingsurface property.

In some embodiments, the reflection map is a table of values (e.g.,whether or not there is a reflection, position, incidence angle, and/orsurface property) for each sun position (e.g., without having pixelsrepresenting reflections for each sun position).

In some embodiments, there may be more than one reflection at a sunposition (e.g., a first reflection from a first building and a secondreflection from a second building). The processing logic may determine agreater reflection of the more than one reflection for the sun positionand generate the reflection map based on the greater reflection for thesun position.

In some embodiments, the processing logic may resample using pixelswithin an angular radius to include a range of sun angles in thereflection map.

In some embodiments, each electrochromic device has a correspondingreflection map. In some embodiments, a group of electrochromic devices(e.g., that are controlled together) use a common reflection map. Thecommon reflection map may include first reflections from objects to afirst electrochromic device and second reflections from objects to asecond electrochromic device.

At block 1610, the processing logic determines a current sun position.The processing device may determine the current time of year and lookupthe current sun position in a table that correlates time of year to sunposition.

At block 1612, the processing logic receives sensor data (e.g.,indicating direct sunlight, no direct sunlight, amount of directsunlight, or the like) from one or more exterior sensors.

At block 1614, the processing logic may receive propagation information.The propagation information may be indicative of one or more portions ofa room (e.g., office, conference room, or the like) corresponding to theelectrochromic device where reflections are allowed and/or one or moreportions of the room corresponding to the electrochromic device wherereflections are not allowed. For example, reflections may be allowedonto the ceiling of the room. Reflections may not be allowed at workingstations.

At block 1616, the processing logic determines a desired tinting stateof the electrochromic device based on one or more of the reflection map,the current sun position, the sensor data, or the propagationinformation. For example, the processing logic may determine that thereis direct sunlight based on the sensor data, there is reflection basedon the pixel (or table) of the reflection map corresponding to thecurrent sun position, and the reflection would enter a portion of theroom where reflections are not allowed. The processing logic maydetermine the position, incidence angle, and surface property of thereflection based on the pixel (or table) of the reflection map. Thedesired tinting state may be based on the position, incidence angle,surface property, and/or amount of direct sunlight. In some embodiments,a table includes corresponding tinting states for each combination ofposition, incidence angle, surface property, and/or amount of directsunlight.

In some embodiments, the processing logic generates tinting schedules(e.g., reflection schedules based on the reflections and sun positions)by querying the reflection map. The reflection map may be queried inadvance to generate a schedule for tinting the electrochromic device orthe reflection map may be queried in real-time to determine tint levelsof an electrochromic device.

In some embodiments, the processing logic may minimize frequentswitching of tint levels. The processing logic may determine there areno reflections for a threshold amount of time before untinting theelectrochromic device (e.g., avoid untinting for a rapidly passingcloud, perform untinting responsive to a longer-lasting cloud cover).The processing logic may untint the electrochromic device responsive todetermining that the position of the sun is to correspond to reflectionbeing allowed (e.g., located within an allowable sunlight zone of theallowable sun map) for a threshold amount of time (e.g., not untint ifthe sun is quickly passing through a small allowable sunlight zone).

In some embodiments, the processing logic receives further instructionsfor determining a tint level for the electrochromic device. Theprocessing logic may receive instructions from a building managementsystem, a building security system, a tint selector 120, a dashboardmobile app 142, a dashboard web app 140, etc. For example, responsive tothe building being in heating mode (e.g., during winter months), theprocessing logic may receive instructions from the building managementsystem to maximize untinting of electrochromic devices (e.g., responsiveto no reflection, control the electrochromic devices to be at a 0% tintlevel (highest transmittance)) to improve heat gain from sunlight andreduce the energy required to heat the building. Responsive to thebuilding being in cooling mode (e.g., summer months), the processinglogic may receive instructions from the building management system tomaximize tinting of electrochromic devices (e.g., responsive to noreflections, control the electrochromic devices to be at 50% tint level(mid-level transmittance)) to reduce heat gain from sunlight to reducethe energy required to cool the building. In some embodiments, theprocessing logic receives instructions from the dashboard mobile app 142or dashboard web app 140 of tint levels (e.g., 0% tint level, 50% tintlevel, 100% tint level, etc.) to be used when there are unallowedreflections and when there are not any unallowed reflections (e.g., 75%tint level when unallowed reflections, 5% tint level when no unallowedreflections, etc.).

At block 1618, the processing logic causes a current tinting state ofthe electrochromic device to correspond to the desired tinting state.For example, the processing logic may use the reflection map to tint anelectrochromic device at the time that the sun is reflected from aneighboring building, and then to untint the electrochromic device whenthe sun is no longer reflected from the neighboring building. Theprocessing logic may cause the electrochromic device to be set at a tintlevel (e.g., tinted, untinted) by transmitting instructions to thegateway to control the driver coupled to the electrochromic device.

In some embodiments, the processing logic determines a first desiredtinting state for a first electrochromic device and a second desiredtinting state for a second electrochromic device, where the first andsecond electrochromic devices are controlled together (e.g., both arealways at the same tint level). The processing logic may determine ahigher tinting level of the first and second desired tinting states andcause the current tinting state to correspond to the higher tintingstate.

FIG. 16B is a flow diagram of a method 1600B for providing control of anelectrochromic device using an illuminance value, according to certainembodiments.

At block 1632, the processing logic generates a model of a room (e.g.,conference room, office, an interior space of a building that receivesdaylight through an electrochromic device, or the like) and anelectrochromic device. The processing logic may receive dimensions ofthe room and the first electrochromic device and may generate the modelbased on the dimensions.

In some embodiments, the processing logic runs a simulation using themodel to generate a daylight coefficient for the electrochromic device.The daylight coefficient may relate luminance of environment (e.g., thesky, diffuse reflection, light-color surfaces, diffuse surfaces, or thelike) relative to the electrochromic device and inter reflection in theroom (e.g., reflection of luminance from the environment off of aceiling or wall of the room) to an illuminance value at a location inthe room.

At block 1634, the processing logic identifies a location in the room.The location may correspond to location where high daylight illuminanceis not allowed. For example, the location may correspond to a workspace,a seating area, a location where information is to be displayed (e.g., aprojector screen, a display device, a board with written instructions,etc.), or the like. In some embodiments, multiple locations may beidentified for the room.

At block 1636, the processing logic receives sensor data from one ormore exterior sensors. The sensor data may indicate environmentalluminance (e.g., a sky luminance pattern). The sensor data may becollected from a light sensor, a combination of light sensors, or acamera. Both light sensor data and camera data may be used incombination. For example, the sensor data may indicate a hemisphere ofluminance relative to the electrochromic device (e.g., due to the sun,clouds, diffuse reflection from diffuse surfaces, or the like). Theprocessing device may discretize the environmental luminance intodiscretized patches of the hemisphere of luminance.

At block 1638, the processing logic determines, based on the model andthe sensor data, an illuminance value at the location in the room. Theprocessing logic may use the daylight coefficient and one or morediscretized patches of the hemisphere of luminance (e.g., based on thesensor data) to determine the illuminance value at the location of theroom.

In some embodiments, the processing logic may receive an obstruction mapthat indicates an obstructed portion and/or an unobstructed portion ofthe sky as viewed from the electrochromic device. The processing logicmay determine the first illuminance value further based on theobstruction map. For example, the processing logic may only considerdiscretized patches of the hemisphere of luminance (or portions of thediscretized patches) that are not obstructed.

The illuminance value may correspond to a vertical eye illuminance atthe location in the room. The illuminance value may correspond to adaylight glare probability via the electrochromic device at the locationin the room. For example, certain illuminance values may be consideredglare at certain locations of the room (e.g., an illuminance level thatinterferes with use of that location of the room). The illuminance valuemay represent diffuse horizontal irradiance and direct normal irradiancevia the electrochromic device to the location in the room.

At block 1640, the processing logic determines a desired tinting stateof the electrochromic device based on the illuminance value. In someembodiments, the location has an allowed illuminance value. The desiredtinting state may be the amount of tinting to decrease the illuminancevalue to an allowed illuminance value.

In some embodiments, multiple electrochromic devices provide daylight tothe same room. The processing logic may determine a correspondingilluminance value at the location in the room for each of theelectrochromic devices. The desired tinting state may be based on thecombination of the illuminance values (e.g., the sum of the illuminancevalues) corresponding to the location in the space.

In some embodiments, the processing logic may minimize frequentswitching of tint levels. The processing logic may determine there is anallowable amount of illuminance for a threshold amount of time beforeuntinting the electrochromic device (e.g., avoid untinting for a rapidlypassing cloud, perform untinting responsive to a longer-lasting cloudcover). The processing logic may untint the electrochromic deviceresponsive to determining that the position of the sun is to correspondto an allowable amount of illuminance for a threshold amount of time(e.g., not untint if the sun is quickly passing through a smallobstructed portion of the obstruction map).

In some embodiments, the processing logic receives further instructionsfor determining a tint level for the electrochromic device. Theprocessing logic may receive instructions from a building managementsystem, a building security system, a tint selector 120, a dashboardmobile app 142, a dashboard web app 140, etc. For example, responsive tothe building being in heating mode (e.g., during winter months), theprocessing logic may receive instructions from the building managementsystem to maximize untinting of electrochromic devices (e.g., responsiveto direct sunlight being obstructed, control the electrochromic devicesto be at a 0% tint level (highest transmittance)) to improve heat gainfrom sunlight and reduce the energy required to heat the building.Responsive to the building being in cooling mode (e.g., summer months),the processing logic may receive instructions from the buildingmanagement system to maximize tinting of electrochromic devices (e.g.,responsive to direct sunlight being obstructed, control theelectrochromic devices to be at 50% tint level (mid-leveltransmittance)) to reduce heat gain from sunlight to reduce the energyrequired to cool the building. In some embodiments, the processing logicreceives instructions from the dashboard mobile app 142 or dashboard webapp 140 of tint levels (e.g., 0% tint level, 50% tint level, 100% tintlevel, etc.) to be used when there are certain illuminance values.

At block 1642, the processing logic causes a current tinting state ofthe electrochromic device to correspond to the desired tinting state.For example, the processing logic may use a first illuminance value at afirst point in time to tint an electrochromic device at the time thatthe sun comes over a neighboring building, and then to untint theelectrochromic device when the sun is blocked by an overhang. Theprocessing logic may cause the electrochromic device to be set at a tintlevel (e.g., tinted, untinted) by transmitting instructions to thegateway to control the driver coupled to the electrochromic device.

In some embodiments, the processing logic generates a desired tintingstate for each of two or more locations in the room. The processinglogic determines a higher tinting state (e.g., darker tinting state,tinting state corresponding to less transmission of sunlight) based on agreater of the first or second tinting state and causes the currenttinting state to correspond to the higher tinting state.

FIG. 16C is a flow diagram of a method 1600C for providing automatedcontrol of an electrochromic device, according to certain embodiments.Method 1600C illustrates automated control of an electrochromic deviceusing a reflection map, an obstruction map, and an illuminance value. Insome embodiments, method 1600C may provide automated control using twoor more of a reflection map, an obstruction map, or an illuminancevalue. In some embodiments, method 1600C may provide automated controlusing one or more of a reflection map, an obstruction map, or anilluminance value plus an additional way (e.g., method, process, etc.)of determining a desired tint level.

At block 1662, the processing logic determines a current sun position.Block 1662 may be similar to block 1610.

At block 1664, the processing logic receives a reflection map indicativeof reflections from objects in the environment to the electrochromicdevice for sun positions. The reflection map may be generated based onblocks 1602-1608.

At block 1666, the processing logic determines a first desired tintingstate of the electrochromic device based on the reflection map and thecurrent sun position. Block 1666 may be similar to block 1616.

At block 1668, the processing logic receives an obstruction map thatindicates an obstructed portion and/or an unobstructed portion of theelectrochromic device for sun positions. The obstruction map may begenerated by one or more of methods 300B-D.

At block 1670, the processing logic determines a second desired tintingstate of the electrochromic device based on the obstruction map and thecurrent sun position. Block 1670 may be similar to block 310.

At block 1672, the processing logic receives an illuminance value for alocation in a room based on daylight transmission via the electrochromicdevice. The illuminance value may be determined based on blocks1632-1638.

At block 1674, the processing logic determines a third desired tintingstate of the electrochromic device based on the illuminance value. Block1674 may be similar to block 1640.

At block 1676, the processing logic determines a higher tinting statecorresponding to greater of the first desired tinting state, the seconddesired tinting state, and the third desired tinting state. In someembodiments, the processing logic may determine a higher tinting statecorresponding to the greater of two of more of the first, second, andthird desired tinting states.

At block 1678, the processing logic causes a current tinting state ofthe electrochromic device to correspond to the higher tinting state.Block 1678 may be similar to one or more of blocks 312, 1618, or 1642.

The preceding description sets forth numerous specific details such asexamples of specific systems, components, methods, and so forth, inorder to provide a good understanding of several embodiments of thepresent disclosure. It will be apparent to one skilled in the art,however, that at least some embodiments of the present disclosure may bepracticed without these specific details. In other instances, well-knowncomponents or methods are not described in detail or are presented insimple block diagram format in order to avoid unnecessarily obscuringthe present disclosure. Thus, the specific details set forth are merelypresented as examples. Particular implementations may vary from theseexample details and still be contemplated to be within the scope of thepresent disclosure. In the above description, numerous details are setforth.

It will be apparent, however, to one of ordinary skill in the art havingthe benefit of this disclosure, that embodiments of the disclosure maybe practiced without these specific details. In some instances,well-known structures and devices are shown in block diagram form,rather than in detail, in order to avoid obscuring the description.

Some portions of the detailed description are presented in terms ofalgorithms and symbolic representations of operations on data bitswithin a computer memory. These algorithmic descriptions andrepresentations are the means used by those skilled in the dataprocessing arts to most effectively convey the substance of their workto others skilled in the art. An algorithm is here, and generally,conceived to be a self-consistent sequence of steps leading to thedesired result. The steps are those requiring physical manipulations ofphysical quantities. Usually, though not necessarily, these quantitiestake the form of electrical, magnetic, or optical signals capable ofbeing stored, transferred, combined, compared, and otherwisemanipulated. It has proven convenient at times, principally for reasonsof common usage, to refer to these signals as bits, values, elements,symbols, characters, terms, numbers, or the like.

It should be borne in mind, however, that all of these and similar termsare to be associated with the appropriate physical quantities and aremerely convenient labels applied to these quantities. Unlessspecifically stated otherwise as apparent from the above discussion, itis appreciated that throughout the description, discussions utilizingterms such as “receiving,” “identifying,” “generating,” “determining,”“causing,” “casting,” sampling,” “resampling,” “running,” or the like,refer to the actions and processes of a computer system, or similarelectronic computing device, that manipulates and transforms datarepresented as physical (e.g., electronic) quantities within thecomputer system's registers and memories into other data similarlyrepresented as physical quantities within the computer system memoriesor registers or other such information storage, transmission or displaydevices.

Embodiments of the disclosure also relate to an apparatus for performingthe operations herein. This apparatus may be specially constructed forthe required purposes, or it may comprise a general purpose computerselectively activated or reconfigured by a computer program stored inthe computer. Such a computer program may be stored in acomputer-readable storage medium, such as, but not limited to, any typeof disk including floppy disks, optical disks, CD-ROMs, andmagnetic-optical disks, read-only memories (ROMs), random accessmemories (RAMs), EPROMs, EEPROMs, magnetic or optical cards, or any typeof media suitable for storing electronic instructions.

The algorithms and displays presented herein are not inherently relatedto any particular computer or other apparatus. Various general-purposesystems may be used with programs in accordance with the teachingsherein, or it may prove convenient to construct a more specializedapparatus to perform the required method steps. The required structurefor a variety of these systems will appear from the description below.In addition, the present embodiments are not described with reference toany particular programming language. It will be appreciated that avariety of programming languages may be used to implement the teachingsof the present disclosure as described herein. It should also be notedthat the terms “when” or the phrase “in response to,” as used herein,should be understood to indicate that there may be intervening time,intervening events, or both before the identified operation isperformed.

It is to be understood that the above description is intended to beillustrative, and not restrictive. Many other embodiments will beapparent to those of skill in the art upon reading and understanding theabove description. The scope of the disclosure should, therefore, bedetermined with reference to the appended claims, along with the fullscope of equivalents to which such claims are entitled.

What is claimed is:
 1. A method comprising: receiving a first imagecaptured from a first viewpoint of an electrochromic device associatedwith a room, wherein the first viewpoint faces exterior of the room;identifying at least one of: an obstructed portion of the first imagecorresponding to a first portion of the electrochromic device that isobstructed from receiving direct sunlight; or an unobstructed portion ofthe first image corresponding to a second portion of the electrochromicdevice that is unobstructed from receiving the direct sunlight;generating an obstruction map based on the at least one of theobstructed portion of the first image or the unobstructed portion of thefirst image; determining, based on the obstruction map, a first desiredtinting state of the electrochromic device; and causing a currenttinting state of the electrochromic device to correspond to the firstdesired tinting state.
 2. The method of claim 1 further comprising oneor more of: receiving first dimensions of the electrochromic device andsecond dimensions of one or more obstructions of the electrochromicdevice, wherein the obstruction map is to be further generated based onthe first dimensions and the second dimensions; or receiving athree-dimensional (3D) model of environment relative to theelectrochromic device, wherein the obstruction map is to be furthergenerated based on the 3D model.
 3. The method of claim 1 furthercomprising: receiving propagation information indicating one or moreportions of the room where the direct sunlight is allowed, wherein thedetermining of the first desired tinting state of the electrochromicdevice is further based on the propagation information.
 4. The method ofclaim 1 further comprising: receiving a sun map indicating position ofsun relative to the electrochromic device; and receiving sensor datafrom one or more exterior sensors, wherein the determining of the firstdesired tinting state of the electrochromic device is further based oncomparing the obstruction map to the sun map to determine whether thesun is within the unobstructed portion of the obstruction map anddetermining, based on the sensor data, whether there is current directsunlight.
 5. The method of claim 1, wherein the obstruction map isgenerated based on merging the first image captured from the firstviewpoint with a second image captured from a second viewpoint of theelectrochromic device.
 6. The method of claim 1, wherein the obstructionmap is stored in an orthonormal pseudo-cylindrical format.
 7. The methodof claim 1 further comprising: generating a reflection map based on aplurality of reflections, wherein each of the plurality of reflectionsis from a corresponding surface of one or more objects to theelectrochromic device for a corresponding sun position; determining,based on the reflection map and current sun position, a second desiredtinting state of the electrochromic device; determining a higher tintingstate based on greater of the first desired tinting state or the seconddesired tinting state; and causing the current tinting state of theelectrochromic device to correspond to the higher tinting state.
 8. Themethod of claim 1 further comprising: receiving an illuminance value fora location in the room based on daylight transmission via theelectrochromic device; determining, based on the illuminance value, asecond desired tinting state of the electrochromic device; determining ahigher tinting state based on greater of the first desired tinting stateor the second desired tinting state; and causing the current tintingstate of the electrochromic device to correspond to the higher tintingstate.
 9. A system comprising: a memory; and a processing devicecommunicably coupled to the memory, the processing device to: receive animage captured from a first viewpoint of an electrochromic device,wherein the first viewpoint faces exterior to a room; identify, based onthe image, the at least one of an obstructed portion or an unobstructedportion of the electrochromic device; generate, based on the at leastone of the obstructed portion or the unobstructed portion, anobstruction map that indicates at least one of the obstructed portion orthe unobstructed portion of the electrochromic device; generate anallowable direct sunlight map indicating one or more portions of theroom where direct sunlight is allowed; overlay the allowable directsunlight map on the obstruction map to generate a composite map;determine, based on the composite map, a first desired tinting state ofthe electrochromic device; and cause a current tinting state of theelectrochromic device to correspond to the first desired tinting state.10. The system of claim 9, wherein the processing device is further toone or more of: receive first dimensions of the electrochromic deviceand second dimensions of one or more obstructions of the electrochromicdevice, wherein the obstruction map is to be generated based on thefirst dimensions and the second dimensions; or receive athree-dimensional (3D) model of environment relative to theelectrochromic device, wherein the obstruction map is to be generatedbased on the 3D model.
 11. The system of claim 9, wherein the processingdevice is further to: receive a sun map indicating position of sunrelative to the electrochromic device; and receive sensor data from oneor more exterior sensors, wherein: the obstructed portion corresponds toa first portion of the electrochromic device that is obstructed fromreceiving the direct sunlight; the unobstructed portion corresponds to asecond portion of the electrochromic device that is unobstructed fromreceiving the direct sunlight; and to determine the first desiredtinting state of the electrochromic device, the processing device is tocompare the composite map to the sun map to determine whether the sun iswithin the unobstructed portion of the obstruction map and determine,based on the sensor data, whether there is current direct sunlight. 12.The system of claim 9, wherein the processing device is further to:generate a reflection map based on a plurality of reflections, whereineach of the plurality of reflections is from a corresponding surface ofone or more objects to the electrochromic device for a corresponding sunposition; determine, based on the reflection map and current sunposition, a second desired tinting state of the electrochromic device;determine a higher tinting state based on greater of the first desiredtinting state or the second desired tinting state; and cause the currenttinting state of the electrochromic device to correspond to the highertinting state.
 13. The system of claim 9, wherein the processing deviceis further to: receive an illuminance value for a location in the roombased on daylight transmission via the electrochromic device; determine,based on the illuminance value, a second desired tinting state of theelectrochromic device; determine a higher tinting state based on greaterof the first desired tinting state or the second desired tinting state;and cause the current tinting state of the electrochromic device tocorrespond to the higher tinting state.